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FOREWORD 



Nearly four million handicapped children In the United States— 200,000 
In Pennsylvania alone— are not receiving the special educational services that 
they require In order to become self-supporting, self-respecting citizens. In 
order to adequately provide for these children, almost 300,000 more specially 
trained persons are needed to work with handicapped children. The present 
methods of training educational personnel cannot provide enough trained people 
to meet these needs. 

CARE 1 was developed to provide a complete college-level computer- 
assisted Instruction (CAI) course dealing with the Identification and diag- 
nosis of handicapping conditions In children. The course was aimed toward 
preschool and primary level teachers of seemingly typical children. 

This course has been designed to demonstrate the contribution that new 
educational technology can make In the education and training of teachers 
(especially Inservlce teachers) and In providing high quality education to 
teachers who might not have the opportunity to return to a college campus for 
refresher training^ It Is hoped that the course will dramatize the effect 
that educational technology can have In the field of special education. 

Personnel in the department of Special Education and Elementary Education 
and the Computer Assisted Instruction Laboratory at The Pennsylvania State 
University have cooperated to develop the program for the IBM 1500 Instruc- 
tional System located at Penn State. When completed, the course was then 
transferred to an IBM 1500 System In a mobile laboratory and disseminated to 
teachers throughout the Pennsylvania Appalachian Region. 

This Final Report of CARE 1 Is In five volumes. Volume 1 covers the 
purpose and objectives of the course, the nature of CAI, a general course 
description, phases of development, course materials, and evaluative methods 
and results. Volume II Is the CARE 1 Handbook , which Is not only a summary 
of the course but also a valuable tool for the student while he takes the 
course. A Syllabus describing the content and objectives of each Instruc- 
tional frame Is Volume III. Volume IV Is a planning manual, a detailed 
description of all the programing techniques used In CARE 1. It Is not only 
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a report but Is also designed as a programer's guide for future CAI courses. 
Volume V Is a computer tape which contains the entire CAI course In an easily 
readable form. The tape also contains all the Coursewrlter II coding. 
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CHAPTER I 



PROBLEM. ACTIVITIES. AND IMPLICATIONS 

Introduction and Overview 

This project attempted to Improve the quality of experienced teacher 
preparation In the area of special education. A computer-assisted Instruction 
course was developed which would provide Intensive training In special educa- 
tion concepts to regular classroom teachers of elementary grades In rural 
schools In Pennsylvania's sparsely populated counties. A high proportion of 
the children In these counties come from low-Income families who must depend 
heavily upon their local schools for long-term support and escape from poverty. 
The situation In Pennsylvania's Appalachian region reflects a pressing 
national need for special educational services. The CARE project was an 
attempt to help provide for this need. 

Justification and Purpose 

The Annual Report of the Bureau of Education for the Handicapped for the 
Fiscal Year 1969 states that over 62% (3.75 million) of the nation's handi- 
capped children received no appropriate special educational services In school 
year 1968-1969 and that an additional 266,000 trained persons were needed but 
not available to provide special services to these children who did not 
receive care. 

This appalling situation o^ unmet needs for educational services for 
handicapped children has not changed materially since the release of those 
statistics. It Is obvious that an alternative or at least an augmented 
approach to the provision of special services to atypical children must be 
undertaken. The CARE project provides one alternative: preparing Inservlce 
teachers of regular grades to Identify and adequately diagnose conditions In 
children which may adv::rsely affect their school performances. 

Specialists In early childhood education and special education continually 
stress the need for early diagnosis of educational or behavioral devlancy, 
followed by early Intervention with programs designed to promote cognitive 
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and social development, In order to help handicapped and disadvantaged 
children get off to a good start In life. It Is the contention of these 
specialists, as well as the designers of this program, that the early years 
of a child's life are extremely Important In terms of personality development 
and Intellectual development. Unfortunately, most preschool and primary level 
teachers have not been trained specifically to Identify children who sre 
handicapped or who exhibit behavior which may be symptomatic of future educa-* 
tlonal difficulties. 

In order to make appropriate educational judgments. I.e., judgments which 
result In educational planning aimed at Intervention for the purpose of pre-* 
venting potential learning problems, correcting existing learning problems, 
or enhancing learning assets, teachers need Information about the atypical 
conditions and characteristics which are likely to be present to some degree 
In groups of school-age children. Information concerning both normal behav- 
ior and possible abnormal behavior In the cognitive, affective, and psycho- 
motor response domains Is the prerequisite for the task of screening children 
with reference to gross deviations. It is assumed that inservice teachers 
possess adequate knowledge concerning nonnal behavior and function in general, 
with expectations of normal behavior for the children In their classrooms. 
The developers of CARE 1 maintain that the majority of inservice teachers 
have not had the opportunity to acquire adequate information about the possi- 
ble deviations, or abnormalities. In behavior that influence learning. 
Teachers need adequate information in order to make appropriate educational 
decisions. 

Target Group 

While the course is appropriate for teachers of all grade levels, it Is 
especially directed to preschool and elementary school teachers. It is 
designed to give these teachers the knowledge and skills necessary to identify 
children who otherwise might be educationally retarded by the age of nine or 
ten. The course is also useful to other educational personnel such as prin- 
cipals and other administrators and supervisors, sped a'' class supervisors, 
school nurses, special services personnel, and other school related personnel. 
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Including day care workers. The course attempts to promote clinical sensi-* 
tlvlty on the part of regular classroom teachers and develop In them a diag- 
nostic awareness and understanding of the strengths and weaknesses of handl-* 
capped and normal children. 

Approach 

The question of how best to provide high quality Inservlce education pro- 
grams to large numbers of teachers Is a perennial Issue. When viewed with 
reference to the very large number of handicapped children who would even-* 
tually be affected by these programs, the Issue becomes crucial. The 
designers of this program maintain that. In contrast to the traditional 
approaches to Inservlce teacher education, a more Individualized approach Is 
more effective and efficient. Support for this method of approach can be 
found In several research studies. For example, Rudd (1957) found that 
Inservlce courses were of higher calibre when an Individual teacher's back- 
ground was taken Into consideration and the Inservlce course was presented at 
the local level In close proximity to the elementary classroom. Houston, 
Boyd, and Devault (1962) worked with 252 elementary teachers In a multi-media 
approach which used closed circuit television, lecture, question-discussion, 
and written materials. They found that the teachers preferred the written 
materials and the question-discussion approach to teaching. Between March 1, 
1969, and August 29, 1969, a CAI course In mathematics developed at the Penn 
State Computer Assisted Instruction Laboratory was given to a total of 387 
elementary school teachers In Dryden, Virginia; Gladevllle, Virginia; and 
California, Pennsylvania. It was concluded that It Is feasible and desirable 
to Incorporate CAI programs Into Inservlce teacher education. The researchers 
for this program In remedial education, therefore, decided that administra- 
tors should consider procedures for Individualizing Inservlce education pro- 
grams for teachers. 

The method of Individualizing Instruction used In this program was 
computer-assisted Instruction (CAI). CAI provides an environment In which 
the material presented to the learner Is selected and sequenced, with the aid 
of a computer, to be responsive to the Individual learner's needs. The 
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computer program selects sequences of instruction which are appropriate to an 
Individual 's background knowledge of the course content, his rate of progress 
through the material, and the types of errors (or non-errors) the student 
makes as he interacts with the system. Of a11 the methods of individualized 
Instruction, Including team teaching, programed texts, and low student/teacher 
ratios, CAI appears to offer the greatest promise for the major objective of 
Individualized 1nstruction-*-*1mproved learning by the student. 

Mobile Laboratory 

The Impact of the CARE course with regard to the Individualization of 
Instruction has been maximized by the Penn State mobile CAI laboratory, a new 
and Innovative concept In Inservlce teacher education. The Mobile Laboratory 
Is a custom built trailer with expandable sides and a specially designed "air 
ride." It Is fu11y heated and air conditioned and Is equipped with a complete 
IBM 1500 System and fifteen student Instructional stations. Specifications 
for the van appear In Appendix A. 

The van's mobility allows for dissemination of the course to large numbers 
of teachers residing In remote parts of the state. Hauled by a tractor, the 
Laboratory Is located for six- to eight-week periods at centrally situated 
school buildings In selected Appalachian regions (see Appendix B). During 
these periods (and at times convenient for them), teachers, supervisors, and 
other Interested educational personnel come to the Mobile Laboratory to take 
the CARE course. A maximum of 150 persons can be accommodated at each site. 

Summary 

The overall objective of this program was the development of educational 
procedures appropriate for a computer-assisted Instruction course for Inservlce 
teachers. The purpose of the course was to train teachers In diagnostic and 
clinical assessment skills necessary for the Identification and diagnosis of 
handicapping conditions In children. 
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CHAPTER II 
COURSE DESCRIPTION 

Purpose 

The purpose of the course called Computer Assisted Remedial Education 
(CARE 1) Is to give educational personnel the knowledge and skills necessary 
to deal effectively with children who have educational problems. 

The course Is appropriate for teachers of a11 grade levels but especially 
for preschool and elementary school teachers ^ The course is designed also to 
be of Interest to other educational personnel such as principals and other 
administrators and supervisors; special class supervisors; school nurses; 
psychologists; aids; music, art, shop, and physical education specialists; 
special services personnel; and other school related personnel Including day 
care workers. 

The CARE 1 course Is deslgrsd to prepare Inservlce preschool and primary 
level elementary teachers and other Interested persons to know the charac- 
teristics of, and be able to Identify, handicapped ch11dren« Handicapped 
children are defined, for purposes of this course, to be those children who 
have atypical conditions or characteristics which have relevance for educa* 
tlonal program1ng« Handicapped children include children who display devia* 
tlons from normal behavior In any of the following domains: a) cognitive, 
b) affective, and c) psychomotoro 

The philosophy of the course Is such that teachers are encouraged to 
look at children as IndlvldualSo The use of traditional categories or labels 
Is minimal. However, certain terms and concepts related to handicapping con- 
ditions are taught so that persons who take this course are better able to 
communicate with other professionals In the rield. 

Objectives 

Upon completion of the CAI course, participants will have achieved the 
following objectives that are directly correlated with the decision process 
flowchart shown in Figure K Participants will: 



A. know the characteristics of handicapped children and 
be aware of symptoms which are Indicative of potential learning 
problems; 

B. be able to screen all children In regular classroom 
programs for deviations and determine the extent of inter-indivi- 
dual differences; 

C. be able to select and use appropriate commerlcal and 
teacher-constructed appraisal and diagnostic procedures for those 
children with deviations In order to obtain more precise Informa-* 
tlon related to the nature of the deviation; 

D. be able to synthesize Infomatlon by preparing Indivi- 
dual profiles of each child's strengths and weaknesses of educa-* 
tlonally relevant variables; 

E. be able to evaluate the adequacy of the available infor- 
mation in order to make appropriate decisions about referral to 
specialists; 

F. be able to prepare adequate documentation for a child If 
the decision to refer Is affirmative. 

It Is expected that the teachers who exhibit the competencies listed 
above will systematically evaluate children's learning potential and formulate 
appropriate educational plans according to the decision process outlined In 
the following section. 

Relationship Between Objectives 
and the DecTslon Process 

The six objectives are directly associated with the first six steps 
(boxes) In the decision process (Fig. 1). The first two steps In the decision 
process dictate that the teacher evaluate all the children in the classroom In 
order to Identify those children who exhibit deviations from normal behavior. 
Objectives A and B are related to the First and Second Steps In the decision 
process. 

Evaluation should be thought of as a continuous process which Is an Inte- 
gral part of the total educational effort. The evaluation process Includes 



1 . iContlnually evaluate all children In order to 
^.Identify children with deviations from normal 
•^expectations. 



Objective 




3. 



Gather more precise Information about the 

nature and the extent of the deviations. 
Objective C 




(Modify the child's 
educational program on 
the basis of Informa- 
tlon obtained >) 



Prepare adequate documentation and make the 
appropriate referral . 

Objective F 



This step Is the subject of a CAI course to be developed. 

Fig. 1. Decision Process. 
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two major tasks: a) obtaining both quantitative (numerical) and qualitative 
(categorical) data about children's abilities In the cognitive, affective, 
and psychomotor response domains; and b) making value judgments about these 
data. To Identify children who exhibit deviations from normal expectations 
Is to make a value judgment that a particular behavior is considerably differ-* 
ent from that which Is displayed by a majority of the child's chronological 
age peers and Is, therefore, different from the behavior usually expected of 
children In that age group. 

In order to make appropriate educational judgments (i.e. judgments which 
result In educational , banning aimed at intervening for the purpose of pre- 
venting potential learning problems, correcting existing learning problems, 
of enhancing learning assets), teachers need Information about the atypical 
conditions and characteristics which are likely to be present, to some degree. 
In groups of school age children. Information concerning both normal behav- 
ior and possible abnormal behavior In each of the response domains (cognitive, 
affective, and psychomotor) Is prerequisite for the task of screening children 
with deviations. It Is assumed that Inservlce teachers possess adequate knowN 
edge concerning normal behavior and operate. In general, with expectations of 
normal behavior for the children In their classrooms. The Investigators main- 
tain that the majority of Inservlce teachers have not had an opportunity to 
acquire extensive Information about possible deviations, or abnormalities, in 
behavior which Influence learning. Therefore, course content used In associa- 
tion with Objective A provides the basic Information which Is the prerequisite 
for the screening task (Steps One and Two) and for subsequent tasks In the 
decision process. 

The following Items are examples of the course content for Objective A: 
a) definitions of atypical children; b) descriptions of various groups of 
atypical children such as mentally retarded and emotionally disturbed children; 
c) descriptions of children with speech, motor, auditory, and visual problems; 
and d) Justification for the use of certain variables In describing atypical 
children. Since the course Is Intended for teachers working with preschool 
and primary level children who may not yet manifest clear-cut signs of atyp- 
ical behavior, teachers are given Information related to the more subtle clues 
to Incipient problems. 



Acquisition of the prerequisite Information allows the teacher to Iden- 
tify, or screen out, those children who exhibit deviations from normal behav- 
ior. Achievement of Objective B enables the teacher to make correct use of 
data which are usually readily available to classroom teachers. Course con- 
tent directed toward Objective B focuses on the following: a) the relative 
nature of normality In terms of soclo-cultural factors, and societal and r.u- 
catlonal expectations; b) Inter- and Intra- Individual differences; c) Inter- 
pretation of Information which Is generally available for all children In the 
group such as results of group Intelligence, readiness, and achievement tests, 
questionnaire responses concerning home and family; and d) the continuous and 
circular nature of the screening process. 

During the first phase of the decision process, the teacher surveys the 
entire group of children for performance on certain relevant variables In 
order to select those Individuals who exhibit deviations of a sufficient 
degree to warrant more Intensive diagnosis. With the completion of the 
screening at any one time, the teacher will have formulated "suspicions" or 
hypotheses about some of the children In the group and will proceed to the 
third step In the decision process for these children. It should be noted 
that the teacher would continue to use the screening process as new group data 
become available. 

During the third step In the decision process, the teacher gathers pre- 
cise Information concerning the nature and the extent of each Individual 
child's deviation. Objective C Is associated with this step. At this point, 
the teacher adds Information about each child's Intra-lndlvldual differences 
to that previously obtained (In the first step) about the Inter-Individual 
differences. The teacher needs to obtain data concerning discrepancies within 
the Individual's growth pattern (the child's specific abilities and disabil- 
ities) and for each of the children selected during the screening process. 

Achievement of Objective C enables the teacher to perform at the third 
stage of decision making. Course content for Objective C Includes: a) 
rationale for use of a variety of appraisal procedures; b) use of convnerlcally 
prepared tests and non- testing materials; c) techniques of constructing and 
using teacher-made tests and non-testing procedures, both formal and Informal; 
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d) criteria for selection of appraisal procedures with emphasis on validity 
and reliability relative to a variety of purposes; e) sources of Information 
about the child from other Individuals, such as peers and parents; f) use of 
day-to-day Informal situations, devised by the teacher, to yield Information 
about attainment of specific behaviors of interest. The emphasis at Step 
Three of the decision process, and for Objective C, is on Individualizing 
appraisal for each child with reference to the deviations noted during 
screening. The teacher seeks Information in addition to that which is usually 
available for all children, and this Information will be unique to the devia- 
tion for which the child was screened out of the total group. 

Tentative completion of the third stage in the decision process, together 
with achievement of Objectives D and E, enables the teacher to evaluate the 
comprehensiveness of the obtained data and, therefore, make the decisions 
required In Steps Four and Five. Course content associated with Objective D 
Includes: a) description of profile charts and related diagrams; b) pro- 
cedures for selecting certain variables for Inclusion In an Individual's pro- 
file; c) Interpretation of normative data; d) rationale for the use of various 
kinds of Information, from a variety of sources. In combination; and e) tech- 
niques of constructing and using profile charts and related diagrams. Course 
content for Objective E consists of: a) criteria for determining the compre- 
hensiveness of the obtained data; b) Information concerning the specialists 
who can be expected to provide various types of Intensive diagnostic services 
for children; and c) descriptions of the classroom teacher's role In relation 
to the roles of various specialists. 

If the teacher makes a negative decision at Step Four, he needs to return 
to Step Three and collect the Information required to complete the child's 
profile chart before proceeding through to Step Five. However, If the teacher 
Is able to make an affirmative decision at Step Four, he will proceed Imme- 
diately to the next decision block, which Is Step Five In the process. 

In formulating an answer to the question posed at Step Five, the teacher 
asks himself: Have I exhausted all sources of Information available to me In 
n\y role as a classroom teacher? Can I make educational plans for this child 
on the basis of Information currently available? Do I need more Information 
before making educational plans for this child? 
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If the decision at Step Five Is for referral, the teacher will proceed 
to Step Six. Objective E Is related to Step Six. Course content associated 
with Step Six Includes: a) criteria for selecting the appropriate specialist 
for various type« of referrals; b) procedures to be used In documenting the 
request for referral; c) descriptions of general procedures to be followed In 
making referrals; d) activities which might be required of the teacher sub- 
sequent to requesting a referral ; and e) feedback to be expected by the 
teacher relative to disposition of the referral. 

If the decision for referral at Step Five Is negative, the teacher will 
be responsible for modification of the child's educational program within the 
regular classroom setting (Step Seven In the decision process). It Is not 
possible In this one course to deal with extensive modification of pedagogical 
programs. A second course Is planned to cover this problem. Modification of 
programs for atypical children would Include the following topics: a) tech- 
niques of effective classroom management; b) specialized teaching strategies 
which might be used for amelioration of difficulties, or for enrichment. In 
various subject-matter areas; c) special materials to be used In association 
with specific strategies, d) sources of Information regarding specialized 
strategies and materials; and e) resource persons usually available to assist 
classroom teachers. 

Structure 

The CARE 1 course Is divided Into twenty-two chapters, each chapter being 
a relatively discrete portion of Instructional Information. The general struc 
ture Is shown on the following page In Figure 2. 

The course Is Introduced by the segment called How To , which Is designed 
CO familiarize the student with the various parts of the computer terminal 
(the CRT, the Image projector, the audio unit, and the earphones) and with the 
methods of responding (the keyboard and the light pen). The student Is also 
asked In this on-line segment to provide the biographical Information needed 
to satisfy the requirements of the federal sponsoring agency. 

Chapters 1 through 5 present background Information and serve as an Intro 
ductlon to the rest of the course. Chapter 1 presents the structure of the 
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Outline of CARE 1 



Chapter Title Segment Labels 





How To; BIB (Biographical 








Inventory) 


0 


aaOl/blbOla 


1 


Overview 


3 


aaOla 


2 


Information Processing Model 


30 


daOla 


3 


Interrelationship of Handicaps 


«««« 
33 


ddOla 


4 


Gathering Information About Children 


1 A 

10 


aOOla 


5 


Decision Process 


zo 


caOla 


c 
D 


Mental Retardation 


40 


cZOIa 






4Z 


ecOla 


7 


Cultural Disadvantage 


46 


A^A 1 ^ 

egOla 


8 


Emotional Disturbance 


5Z 


enOla 






53 


emOla 


9 


Visual Problems 


60—64 


faOla 


10 


Hearing Problems 


65 


gaOlu 


1 1 


opeecn r roD i ems 


ill 


nau la 




71 


hbOla 


12 


Motor and Health Problems 


80 


jaOla/jbOla 






81 


jcOla 


13 


Learning Disability 


92 


jnOla 


14 


Individual Differences and Normality 


6 


abOla 






4-5 


aeOla/afOla 


15 


Profiles of Individual Differences 


7 


ahOla 


16 


Reliability* Validity* and Usability 


11 


alxl 




12 


bcOla 


17 


Screening Instruments* Part Onpt 


41 


ebOla 


18 


Screening Instruments* Part Two 


23 


cdOla 


19 


Screening Instruments* Part Three 


24 


ceOla 


20 


Documentation and Referral Procedures 


96 


jpOla 


21 


Case History 


100 


kaOla 






101 


ka73a 






102 


kb60a 


22 


Summary 


105 


maOla 




Final Examination 


120 


mOOla/al— nl7 






127 


Sign-off 



i 

: 

Fig. 2. General structure of CARE 1 course. 
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course and states the overall objectives Chapters 2» 3, and 4 present basic 
concepts Integral to the course content, and Chapter 5 Introd'jces the Decision 
Process Flowchart that is used as an organizational guideline throughout the 
course. 

Chapters 6 through 13» as their titles Imply » each present information 
about the symptoms and typical behaviors of children wUh a particular disabil- 
1ty« Attention is also given to the appropriate specialists to whom the 
disabled child should be referred and methods of dealing with the child in 
the regular classroom. 

Chapters 14» 15, and 16 deal with the quantitative measurement of educa- 
tional variableSo Chapter 16 also serves as an introduction to the use of 
screening instruments. 

Chapters 17, 18, and 19 each present a thorough examination of an instru- 
ment used to Identify children who are likely to have difficulty in regular 
educational programs » Emphasis is placed on the appropriate uses of each 
Instrument and on proper administration and scoring procedures. 

Chapter 20 is concerned with the adequate documentation of the symptoms 
and behaviors of children who are to be referred to a special isto The chapter 
also Introduces the techniques of behavior modification as a means of dealing 
with problem children while they remain in the regular classroom. 

Chapter 21 consists of three case studies. Following the guideline of 
the Decision Process Flowcharts, the learner is required to gather information 
and make appropriate educational decisions for each of these children as in a 
regular classroom situationo 

Chapter 22 is a brief summary, reiterating the principal concepts that 
are stressed throughout the course. 

After the students have completed the course they are presented the final 
examination consisting of 75 multiple-choice and completion items selected by 
a method of stratified random sampling from a pool of 225 items. The on-line 
stratified random sampling feature enables each student to have an Individually 
selected examination, and It is rare for any two students to be presented with 
the same item simultaneously » 

Upon completion of the CARE 1 course, each teacher earns three Penn State 
graduate credits « 
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Supplemental Materials 

Textbook , The textbook used In conjunction with the on-*11ne material of 
CARE 1 was Teacher Diagnosis of Educational Difficulties edited by Robert M. 
Smith (Charles E. Merrill, Columbus, Ohio, 1969). The book contains contribu- 
tions from nine specialists In all areas of early academic and personal devel- 
opment. These specialists describe methods for diagnosing the strengths and 
weaknesses of Individual students and suggest remedial procedures for helping 
students overcome deficiencies. The book Is designed to help teachers at all 
levels become more effective and efficient In the classroom by appropriately 
using Informal diagnosis In day-to-day evaluations of student progress. It is 
the Intent of the book's editor and co>itr1butors that the development of these 
evaluation procedures will allow teachers the opportunity to Individualize 
their Instructional strategies to accommodate each student's educational needs. 

Handbook . The 400-page Handbook was written especially for CARE 1. It 
Is used by students throughout the course and contains, among other things, a 
350-ltem glossary of critical terms. It has essentially two functions; It Is 
a guide for the student while he takes the course, and It Is a reference tool 
and a comprehensive outline for reviewing course content after the course has 
been conjpleted. Besides the summaries, there are reference materials such as 
charts, tables, student cumulative records, examples of evaluation devices, 
definitions, and samples of key graphic material from the course. At the end 
of each chapter In the Handbook there Is also an up-to-date list of content- 
related references. 

While the student takes the course, he can also use the Handbook to jot 
down notes and observations. In fact, students are urged to keep the Handbook 
with them at all times during on*11ne work. They are also asked to read ahead 
and prepare themselves for their next on-line session. For example, before 
beginning Chapters 1 and 2 on-line, students are asked to read Chapters 1 and 
2 In the Handbook. To facilitate this activity, the Handbook Is divided Into 
chapters which parallel exactly the chapters of the course. 

At the end of each on-line chapter. Handbook reading assignments appear. 
Most of these readings serve as reminders to suggest that the student try to 
keep two chapters ahead of the course. 

A complete Handbook Is Included In this Final Report as Volume II. 
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Screening Instruments . Chapters 17, 18, and 19 of CARE 1 Instruct the 
student In the use of three screening tests (or Instruments): the Denver 
Develojnental Screening Test (DDST) ( Frankenburg . Dodds, and Fandal, 1970), 
the First Grade Screening Test (FGST) (Pate and Webb, 1969) , and the Metro- 
politan Readiness Test (Hlldreth, Griffiths, and McGauvran, 1965). Each stu- 
dent receives his own copy of the tests and simulates the scoring and Inter- 
pretation of results. Validity and reliability Information, standardization 
procedures, and Instructions for administration and scoring are discussed In 
detail. 

Screening tests essentially "screen out" or "sort out" those children who 
deviate slgnlflcantl from the behavior of a normal group of children. 
Screened out children are those who will probably have difficulty progressing 
at the normal rate In a regular school program. 

Screening test results, however, do not reveal the nature of a child's 
problem. Nor do they provide a definitive diagnosis or Indicate r. treatment. 
The diagnostic capabilities of screening tests are very general In nature. 

There are, of course, other sources of Information that can yield 
screening Information. Some are designed to Identify more specific problems 
In children. The Snellen E Chart screens vision problems. X-ray examinations 
will Identify tuberculosis In children. It Is also possible to use the 
results of tests on general mental ability In screening procedures. Screening 
Instruments related to such specific problems are discussed In pertinent 
chapters of the Handbook . 

Data gathered from these and other sources are combined with the regular 
screening tests to provide more accurate results than would be possible with 
the screening test data alone. 

Denver Developmental Screening Test (DDST) 

The DDST was designed to Identify development problems In children. It 
is administered Individually and Is appropriate for children aged about one 
month to six years. 



16 



The DDST form (see Appendix C) contains 105 developmental tasks. Each 
child Is administered only those tasks that are appropriate to his chronolog- 
ical age. The test was designed for people with no special training In psy- 
chological testing and Is relatively easy to adnlnlster and score. 

The 105 tasks are grouped Into four sectors: 

1. personal -social , the ability to get along with others 
and to care for one's self; 

2. fine motor-adaptive, the ability to see and to use 
hands for various purposes; 

3. language, abilities related to hearing and speaking, 
and; 

4. gross motor, abilities such as sitting, walking, and 
Jumpi ng . 

On the scoring sheet, the tasks are grouped according to sector and are posi- 
tioned In relation to a graduated age scale printed across the top and bottom 
of the form. Markings Indicate the age at which certain percentages of the 
children In the normative sample could perform each Item. 

The test kit Includes eight Items such as a rattle, colored boxes, and 
a small bell which are used for eliciting the children's responses. 

First Grade Screening Test (FGST) 

The First Grade Screening Test was designed to screen out children who 
would probably have difficulty learning at the first grade level. There are 
children who would not, without special help, make sufficient progress In the 
first grade to be ready for the second grade. The fgst serves to prevent 
them from suffering the experience of failure. 

The FGST Is administered to children at the end of their kindergarten 
program or at the beginning of their first grade year. Early administration 
of the test provides more time for educational planning. 

The FGST Is a group test. A group of 15 to 20 children seems to be the 
optimum number for efficient administration. Eacii child has his own test 
booklet, with one test Item printed on each page to prevent confusion. There 
is no time limit set on the test, though from 30 to 45 minutes seems to be 
sufficient for most children to finish. 
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There are three major handicaps with which the FGS T deals: Intellectual 
retardation, central nervous system dysfunctions, and emotional disturbance. 
These handicaps are often manifested together or In coirbl nation with one 
another. The FGST yields a single, composite score. When a child receives a 
low score on the test, mere specialized evaluation Is often needed to deter- 
mine the child's specific strengths and weaknesses. 

Metropolitan Readiness Tests 

The Metropolitan Readiness Tests exemplify the use of a group test of 
general aptitude for the purpose of screening. Tests such as the Metropolitan 
Readiness Tests are often routinely administered to children early In their 
school experiences. 

The test Is Intended to measure the extent to which young children have 
acquired skills and abilities which contribute to readi less for the tasks 
typically required In first grade. Those children who perform well on the 
test have a good chance of achieving first grade work without difficulty. 
Those children who do not perform well will probably experience some diffi- 
culty In learning during the first grade. 

The test Is designed to assess -ihe most 1mporta,it components of first 
grade readiness: 

1. comprehension and use of oral language; 

2. visual perception and discrimination; 

3. auditory discrimination; 

4. richness of verbal concepts; 

5. general mental ability; capacity to ''nfer and to reason; 

6. knowledge of numerical and quantitative relationships; 

7. sensory-motor abilities of the kin J required In handwriting, 
writing of numerals, and drawing; 

8. adequate attentlveness; the ability to sit quietly, to listen 
to and follow directions. 

The Metropolitan Readiness Tests j;iould be administered at the end of 

the kindergarten program or at the be',1nn1ng of the first grade year. The 

test Is comprised of six required su /tests and one optional subtest: 
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1 . word meanings; 

2. listening; 

3. matching; 

4. alphabet; 

5. numbers 

6. copying; 

7. draw-a-man (optional) 

The test manual outlines the following uses of the Metropolitan Readiness 
Tests for the classroom teachers: 

1. obtain quick Indication of readiness of each of his 
pupils to do first grade work, especially with reference to 
reading and arithmetic; 

2. Identify specific areas In which a child (or group) 
appears not to have attained the level of maturity of skill 
adequate for coping with first grade work; 

3. as an objective, reliable basis for the Initial 
grouping of pupils for Instructional purposes; 

4. assess the range of readiness among his pupils so as 
to tetter define Instructional problems; 

5. adapt Instruction to the level of the class and of 
subgroups he may organize; 

6. Indicate when formal work In numbers and In reading 
should be started; 

7. determine whether pupils have progressed In accordance 
with their readiness or aptitude by comparing readiness test 
results with achievement test results or teacher grades at the 
end of the year. 
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CHAPTER III 
COMPUTER-ASSISTED INSTRUCTION 



Potential 

It was felt that the most efficient and effective means for providing 
teachers with this much needed Instruction was through computer-assisted 
Instruction (CAI). 

Because each student can learn from and Interact Independently with a 
CAI course, and because the computer program can execute logical decisions 
based on the analysis of Incoming real-time student performance data, there 
exists the capability for Intelligent adaption of Instruction for each student. 
The logical decision making ability of the computer program, along with Its 
extremely rapid access to large volumes of stored Information, combined with 
the knowledge and skill of the author-programer, can provide for a wide 
variety of Individual differences among learners. Mitzel (1967) states: 

Indeed, In sophisticated tutorial programs which 
Involve marty remedial branches and frequent examination 
of the learner's mastery. It Is likely that no two learners 
In a group will ever take the same path through the mate- 
rial. In the tutorial mode, maximum adaptation can be made 
to individual differences exhibited by the learners. 
(Mitzel, '967, p. 5) 

Dick (1965, p. 51) Identified the following potential advantages of 
computer-assisted Instruction: 

1. The computer can carefully control the learning sequence 
of the student; In fact, it forces the student to comprehend each 
frame. It also prevents cheating. 

2. The computer can Judge constructed responses for accuracy. 
When several answers are acceptable, the student Is not left 
wondering whether his response Is correct or Incorrect. 

3. The computer may offer a more stimulating learning situa- 
tion than the dull one sometimes provided by programed texts. 

4. The computer can utilize background information on each 
student, including both personality traits and abilities, for 
constructing learning sequences and Judging responses. 
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5. The computer Is more versatile than the programed 
text. It can teach a wider variety of tasks and employ a 
wider range of auxiliary stlmulus-^presentatlon equipment. 

6. The computer offers data on the entire learning 
session as well as summary data. These data are useful 
both for school records and research purposes* 

7. The computer can be used for a multitude of jobs 
besides Instructing. Grades, attendance records, Inventories, 
scheduling, etc. can be processed by the computer. 

8. The computer may, as a 1ong-*tenn Investment, be less 
expensive and less space-*consum1ng than programed texts. 

In addition to the foregoing advantages, there are several additional 
factors which should be considered. 

1. Intensive use of CAI can generate a unique motlva-* 
tlonal environment. 

2. Student populations of widely varying backgrounds 
can be helped to achieve recognized standards. 

3. Students of lower aptitude can be stimulated by 
controlling the success ratio and maximizing the learning 
reinforcement. This Is of particular Importance for educa- 
tionally and culturally handicapped students. 

4. Inservlce education and refresher courses for teachers 
can be made available with the same CAI system. 

5. Updating Information In the CAI program or changing 
teaching strategies can be accomplished with relative ease. 

6. A uniform standard of quality -^s maintained In every 
location In which the course Is offered. 

When the CARE course was conceived. It was sufficiently clear that the 
potential advantages of CAI warranted much more than the current level of 
experimentation. Based on Initial experimentation. It was found that the 
balance of risk and opportunity was highly favorable. In a learning environ 
ment, for Instance, there are some functions analogous to those In other 
activities to which computers have been successfully applied. The manager- 
men t of Instructional presentation and the monitoring of student performance 
are functions well adapted to the use of computers. It was also clear that 
CAI would provide a way to manage and present Individualized instruction and 
as such, be a powerful Instructional tool. Indeed, there Is little question 
that It will play an Increasingly Important role In education In the future. 
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CAI Teaching Modes 

The CARE 1 course uses a wide variety of Instructional strategies to 
assist learners In reaching the course objectives. All the strategies are 
Interactive and all require active participation by the learner. 

The most prevalent strategy used In the course Is the tutorial mode. 
This mode simulates the master tutor engaging In an interactive dialogue with 
an Individual learner. The tutor presents Information, asks penetrating ques- 
tions, and carefully analyzes the learner's responses to the questions. On 
the basis of the learner's demonstrated understanding or lack of understanding 
of a given concept, the tutor provides alternative courses of Instruction, 
remedial sequences of Instruction or even enrichment material. The tutor can 
move a capable or well-informed learner through a course of Instruction very 
rapidly. Similarly, the tutor can tailor a sequence of Instruction to meet 
the needs of a learner who Is not as capable or d^es not have a good background 
of experience or preparation. 

Since the sophisticated CAI system can perform the chores of dozens of 
tutors rapidly and efficiently, the net effect Is that hundreds of learners 
In the CARE course are Individually tutored In certain special education 
skills. 

The second major mode of Instruction used In the CARE course Is the 
Inquiry approach. This type of activity Is used In the latter stages of the 
course to draw together all the concepts acquired by learners throughout the 
course. This strategy Included simulation of regular classroom problems as 
well. In essence, the Inquiry and simulation modes as used In the CARE course 
are directed problem solving strategies. Learners are told that they have 
access to Information about a class of first-grade children. Three of the 
children In the class are handicapped or have an educational problem of some 
kind. It Is the learner's task. In effect, to screen the class for children 
with educational problems. Identify those children with potential or existing 
problems, and deal with each problem by modifying the child's educational pro- 
gram or making an appropriate referral. The learner begins the screening by 
looking over the cumulative records of the children In the class. After the 
three children most deserving of special attention are Identified, the learner 
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Is able to ask the computer for additional Information about each child. The 
learner Is, In fact, given access to Information irrelevant to the children's 
problems. If a false assumption is made because of faulty reasoning or because 
it is based on Irrelevant or insufficient information, the program allowes the 
learner to follow an Incorrect strategy until the error becomes apparent to the 
learner. 

Eventually, as a result of skillful questioning on the part of the CAI 
program coupled with the appropriate line of questioning by the learner, an 
appropriate diagnosis is made, and a decision is reached by the learner to 
refer the child to a specialist or to modify the child's pedagogical program. 
The learner's decisions and remediational strategies are evaluated by the CAI 
system. 

Facilities 

The Computer Assisted Instruction Laboratory at Penn State has been in 
existence since 1964. Since that time the Laboratory has grown from a staff 
of four part-time faculty members to a present total of 53 University employees 
(faculty, graduate assistants, technicians, and clerical staff), equivalent to 
38 full-time persons. 

Quantity and sophistication of equipment has also changed. The Labora- 
tory, which started with a single teleprocessing typewriter terminal, now has 
a self-contained CAI system. In December 1967, the CAI Laboratory acquired 
and installed the first computerized system designed for instruction— the IBM 
1500 Instructional System. This system is located in Chambers Building on the 
Penn State campus at University Park, Pennsylvania. The system presently con- 
sists of 12 instructional stations, each with a cathode ray tube display, a 
light pen, and a typewriter keyboard. Eight stations have audio record and 
playback devices and an image projector as well. 

The most important device at the instructional station is the cathody ray 
tube (CRT). It is the main interface between the student and the computer and 
is similar in appearance to a small television screen. Lines of text and 
specially designed line drawings appear on the CRT. The screen has an area 
equivalent to 640 display positions, that is, sixteen horizontal rows and 
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forty vertical columns. Information sufficient to fill the screen Is available 
In microseconds from an Internal random access disk. A light pen device is 
attached to the CRT and enables the learner to respond to displayed letters, 
figures, and graphics by touching an appropriate place on the screen. The 
coordinates of the lighted area touched are matched with the programed co- 
ordinates, and appropriate feedback Is displayed. Also attached to the CRT 
Is a typewriter-like keyboard. A student responds by typing an answer which 
appears simultaneously on the CRT at a location established beforehand by the 
course authors. This response Is also matched against a programed response 
with the appropriate feedback given. Four dictionaries of 128 characters each 
can be used either In programing or for a student's response. This, for 
example, would make It possible to teach a mathematics course using four differ- 
ent sets of symbols simultaneously. 

A second medium for presenting course material Is the IBM 1512 Image pro- 
jector. When loaded with a 16mm microfilm reel, the 1512 Is capable of showing 
1,000 still photographic Images In black and white or color. The Images can 
be Individually accessed at the rate of forty Images per second under program 
control . 

A third medium Is the IBM 1506 audio play/record unit. By means of four- 
track magnetic tapes, pre-recorded Information Is presented. The audio 
messages are coordinated with the other Instructional presentation. The audio 
unit also allows the student to record responses which can be analyzed after 
the student has completed the course. 

Equipment to support the Instructional station Is, of course, essential. 
The 1131 Central Processing Unit (CPU) provides storage of data and Is the 
nerve center directing activities of all other components. The 1442 Card 
Read Punch Is used to Input course content from punched cards and to punch out 
previously stored course content. A 1403 Printer lists course content for use 
by a programer or Instructor. Two essential controlling devices are the 1133 
Multiplexer and the 1502 Station Control Unit. The first coordinates disks, 
tapes, and the Instructional devices; the second relays messages from the 
Instructional stations to the Central Processing Unit. There are two 2310 
Disk Storage Drives. Disks containing magnetically stored data operate In 



24 



these disk drives. There are also two 2415 Tape Drives which store such data 
as student performance records. The 1518 typewriter Is an input device much 
like the keyboard on the 1510. It can also type out course infonnation on 
paper. The 029 Card Punch is used for punching codes on standard data proces- 
sing cards. 

The CPU, which can accommodate up to thirty- two student stations with 
these four instructional devices, contains 32,786 sixteen-bit "words" of core 
storage. The 2310 disk drives, which store usable course information and 
operating instructions, consist of 2,560,000 characters. The core storage 
cycle time for the tape drives which record the interaction between the program 
and the student for later analysis and course revision is 3.6 microseconds. 
The read/write time for disk storage is 27.8 microseconds per word. 

Since the computer can record and recall student responses (the number of 
correct answers, the number of wrong answers, and so on), the sequence of 
instruction for a particular student can be altered on the basis of his 
responses. More challenging material or remedial instruction may be presented 
on the basis of past performance, or sections of the course may be skipped if 
the student's performance is at a specific level of proficiency. When a stu- 
dent signs on again to a course after having once signed off, he resumes his 
instruction at his earlier sign-off point. 

The computer can be used to record a variety of information for all stu- 
dents, e.g., the exact contents of his response, the number of seconds he 
takes to respond, and his exact position in a course. Summary information 
such as number of correct responses to a question and total number of response 
attempts may be produced for analysis by the Instructor, thereby reducing the 
teacher's clerical duties and freeing him to give individual instruction. 

The computer will accept course content in two ways: 1) punched on cards, 
or 2) input directly from the instructional station keyboard. Using the sec- 
ond method, the contents of a course can be replaced, corrected, or deleted 
easily and quickly by special author commands. 

Configuration of the system is shown in Appendix D. 

Exterior and interior views of the Penn State Mobile Computer Assisted 
Instruction Laboratory are shown in Appendix E. 
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CHAPTER IV 
COURSE DEVELOPMENT 

All activities undertaken In this project were devoted to the development 
and evaluation of a computer-assisted instruction course dealing with the 
Identification of handicapping conditions In children. A number of specific 
tasks were involved, but each of the tasks was related to the overall purpose 
of the project. The phases and the sequences of tasks are explained in the 
following sections. 

Phase 1; 

Refinement of Course Description 

The first task undertaken by the investigators and research assistants 
was the refinement and expansion of the Course Description (page 5 of this 
report). The Course Description describes the content to be covered in the 
courses and defines the overall strategies to be employed in presenting the 
material. It provides the framework to which specific objectives were added 
during the next phase. When complete, the Course Description indicates the 
procedures that teachers employ in the diagnostic procedures to teach atypical 
children. 

Phase 2; 

Specifying Behavioral Objectives 
for Course segments ana i-rames 

A major step in cours3 development was the identification of the specific 
behavioral objectives of the course. This step was carried out by the investi- 
gators with the aid of the research assistants. In CAI terminology, these 
people are known as authors because they write the course content and specify 
the educational strategies that are to be used. 

The Course Description was used as the basis for developing specific 
objectives. Objectives and desired student behaviors and responses were 
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determined for each interaction between student and CAI system. Each Interac- 
tlon frame required some response from the student; satisfactory responses 
were determined in advance. See Syllabus In Vol. Ill of this report. 



Phase 3; 

writing Course Material 



After Phase One was completed and Phase Two was well underway » the authors 
began writing the course material. The course material was directly related 
to the objectives specified In Phase Two. The purpose of the course material 
was to help the learner achieve the level of performance required for satis- 
factory completion of terminal responses associated with each objective. 

The Investigators determined the sequence of the course material and the 
overall and specific Instructional strategies associated with a given set of 
objectives. The graduate assistants^ after Instruction by the Investigators » 
prepared preliminary Items, graphs, visuals, anticipated responses, and other 
materials required for a given set of objectives. The Investigators then 
reviewed the preliminary material for relevance to objectives and sequencing. 

Course materials and Instructional strategies were planned so as to take 
full advantage of the unique capabilities of the CAI system. These capabil- 
ities provide for Instruction In different media but, more Important, can also 
provide the means by which Individualization of Instruction can be achieved. 
Thus, the authors were able to provide for different amounts of prior knowl-* 
edge of course concepts as well as o.fferent styles of learning and rates of 
progress. 

Phase 4: 

Preparation of Course 
Material Torihe CAI "System 

When segments of course material were written by an author, the segments 
were given to educational programers^ for translation Into a format acceptable 



N. B. Spelling of "programer" and "programing" will be used to Indicate 
CAI applications; "programmer" and "programming" refer to computer applica- 
tions, such as the use of Fortran, Cobol, etc. 



ERIC 
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to the computer system. The course material was translated Into Course* 
writer II, a language designed specifically for computer-assisted Instruction. 
During this phase and the preceding phase, the educational programers con- 
sulted extensively with the authors as programing problems arose. 

The authoring of CAI course material Is an exacting, somewhat laborious 
task. However, the Coursewrlter II language can be learned fairly rapidly 
and Is not as difficult as other computational or business oriented languages. 
Also, an extensive library of short, often used. Instructional "programs" 
(called macros or functions) had already been developed by the Penn State CAI 
Laboratory. These pre-processed "programs" were used by the educational pro- 
gramers for many of the routine "page-turning," branching, comparison, and 
testing aspects of programing. Thus, many of the technical and programing 
problems often associated with computer-assisted instruction had already been 
solved. 

It Is essential that an efficient procedure for processing authored 
material be devised as soon as possible, for the writing and programing of 
text takes up most of the time In the first phase of course development. For 
Instance, basic questions about translating the author's text Into usable 
input must be answered early: How much Coursewrlter language should authors 
be required to know? Must the author Indicate restart points? What percentage 

2 

of the course should be developed by the "deck-building" method? What 
specific operating procedures should be established between the programer and 
keypunch operator? When should "fp's" (Image statements) and "aup's" (audio 
statements) be Inserted? What system should be used for labeling? What 
system should be used for coding "ep Identifiers?" 



"Deck building" Is a method for producing a stack of punched computer 
cards which are then assembled Into the computer. On the IBM 1500 System, 
course material can also be Input "on-line." But this method Is slower, and 
It degrades the system for use by others. 

'For Instance, should coding and text be punched together? Should there 
be an "enter" after every line of text? Should all feedback be In capital 
letters to set It off from other text? How should underlines be handled? 
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The procedure finally adopted for CARE 1 Included four basic steps. 
First, the author wrote out Instructional blocks of material as well as direc- 
tions to the programer on specially designed program sheets. The directions 
usually related to the placement of Images and audio messages and the location 

of branching statements. Though authors were not required to know Coursewrlter, 

4 

they were asked to work within certain broad formating limits. 

In the second step, the programer edited the Instructional text for the 

keypunch operator. That Is, he cleared up Illegibilities and obvious gram- 

5 

matlcal and typographical errors. He also penciled In any unique Coursewrlter 
statements not available In a supply of mass-punched computer cards used later 
In the ''deck-building" process (explained In Step Four). It was found that 
the amount of editing and "penciling In" depended, to a large extent , on the 
competency of the keypunch operator and on the efficiency of the procedure 
followed by the operator and programer. When both competency and efficiency 
are high, certain unspecified assumptions can be made. When not, the programer 
will be required to detail all Instructions, since error- free results at this 
early stage of development are essential. 

In Step Three, the keypunch operator, using the edited program sheets, 
prepared a primary deck of punched cards. They consisted mainly of textual 
material and of unique Coursewrlter statements. These two types of cards were 
punched separately and were combined by the programer during deck-building. 

In the Fourth Step, the programer had two responsibilities: deck-building 
and Initial, on-line debugging. In deck-building, the programer Intercalated 
Into the primary deck unique Coursewrlter statements and the pre-punched state- 
ments most commonly used.^ In CARE 1, each line of text was preceded by a 



It Is probably a good Idea to have authors submit a few of their first 
programing sheets so that errors and problems can be detected before they 
write too much. 

5 

Because Illegibility can cost time and money. It would seem wise to 
show authors as early as possible how self-defeating It can be. 

^Such cards mlaht be dt's (display text), pa's (pause), fn's (functions), 
de's (display erase), etc. 
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single dt (display taxt) card. But because there was a considerable amount 
of text» execu^.lon time was slowed down and disk size was considerably 
expanded. If the alternative usually suggested Is followed In the future, 
that Is, If one dt card Is used for several lines of text. It should be remem- 
bered that the keypunch operator will be required to Insert a return-Index 
after each line of text. 

After the completed CARE 1 deck was assembled Into the computer, the pro- 
gramer's second resp( <s1b111ty was Initial on-line debugging. In this step 
the objective was to Insure that assembled material and course flow corre- 
sponded to the specifications laid down by the author on his programing sheets. 

Phase 5: 

Testing and Revising the Course 

In the development of a CAI course, testing and revision occur continu- 
ously throughout the various phases of course development. Revision of objec- 
tives and course material may occur before the material Is translated Into the 
programing language. Some of the course material may need to be revised before 
the course can be translated Into the programing language or before It can be 
entered Into the system. Some "debugging" and revision usually Is required to 
make the course run smoothly on the system. At this point, authors and pro- 
gramers should "take" the course to check It for errors In sequencing and 
content. 

The second stage of revision began after segments of the course were 
operational. The CARE 1 course was tested by several pilot groups of students. 
Fifteen students took the course In the early summer of 1970, and fifteen stu* 
dents took the course In late summer of 1970. To maximize the benefit of this 
developmental procedure, a system for recording and revising errors was devised. 
Each student In the first pilot group was accompanied by a proctor who 
recorded, on 5 x 8«*1nch cards, the student's comments and the obvious program 
"bugs." (Bugs Included errors In CRT displays, graphic displays. Images, and 
audio messages.) The 5 x 8-Inch cards were then arranged In the correct label 
sequence within segments after being divided according to "concept" revisions 
and "program" revisions. Program revisions went immediately to the programer. 
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Concept revisions were reviewed first by the author then passed on to the pro- 
gramer, often with additional notes. The author then passed on to the pro-* 
gramer certain revisions gleaned from student records. Such things as type of 
errors, number of errors, number of requests for help, response latencies, and 
other Information were analyzed by the author and programers to pinpoint 
problems In content, pedagogy and programing. When all such revisions were 
collected, the programer revised the course segment by segment. 

The same procedure was followed for the second CARE 1 pilot group, except 
that the students recorded comments without the aid of a proctor. 

In the fall of 1970, two advanced graduate students In Special Education 
took the course, following the same recording procedures. In addition, after 
completing the course, these students each compiled a detailed evaluation of 
all the segments of the course with special emphasis on the objectives and the 
effectiveness with which the objectives were met. 

Documentation 

DOCUMENT . CARE 1 is a thoroughly "documented" CAI course. This means 
there exists a complete printed version of not only Its content and strategies 
but of other more specialized types of Information. 

Documentation has become Increasingly necessary as CAI has developed Into 
a viable Instructional mode and as demands for Information about completed 
courses Increase. To a great extent, documentation also reduces the chance of 
duplicating existing courses. 

The primary purpose of documentation, then. Is to provide Information. 
At least three different audiences are Involved: 1) administrators, 2) Ins true 
tors, and 3) programers. In general, administrators will be those responsible 
for purchasing and for curriculum planning. Some may understand computer Ian-* 
guages and programing techniques; most, however, will be concerned with more 
general problems such as systems compatibilities and basic course content. 
Instructors, on the other hand, will be Interested In specific course content. 
In teaching strategies, and In the uses made of different Instructional media. 
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The programer's nterests (either Coursewrlter programers or systcn programmers) 
will be polnte' toward the technicalities of the computer language and toward 
the system rer jlrements. 

Since g' jd documentation should supply Information for all these audiences. 
It must not only Include technical details but also appear In an easy-to-read 
format and In understandable English. The three sections of the documentation 
system pr duced for CARE 1 supply such Information.^ 

Sec. Ion 1 consists of representations of screen (CRT) displays. Along 
with ea.h screen display, there are descriptions of answer processing proce- 
dures .s well as descriptions of activities at an Instructional station: the 
pos.1t oning of Images (and their numbers), the closing of the Image shutter, 
the ^sltlonln^nd playing of audio messages (and their names), the descrlp- 
tlois of response limits, and the coded response Identifiers. The answer mode, 
1, .., keyboard or light pen. Is also Indicated. 

The screen display Itself dominates each page of print out. It Is framed 
n the left by a column of numbers corresponding to screen rows and at the top 
by the numbers of screen columns. Within this frame appears exactly what the 
student sees on the CRT. Though graphics also appear, the system can provide 
only "near" representation. In general, this section of DOCUMENT offers both 
the programers and non-programers a sequential and graphical representation 
of CARE 1 . 

Sections 2 and 3 of DOCLTIENT are of use primarily to programers and/or 
systems personnel. Section 2 Is the coding section containing a complete list 
of Coursewrlter II statements similar to the listing used by programers during 
cuurse development. The DOC'JMENT listing, however. Includes two additional 
features: card sequence aumbers and segment statement numbers. Section 3 Is 
a complete cross-reference table showing not only which audio messages, buffers, 
counters, functions, film Images, labels, etc. have been used but also where 



The program Is called DOCUMENT. Though It was originally written for 
CARE 1, It has now been adapted to most courses developed at the Penn State 
CAI Laboratory. 
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they have been used with respect to course labels. The left column of a print 
out Identifies the Item being referenced: the actual label, a number of an 
Image, the name of a macro, the op code of a function, etc. The next column 
Is a one-character symbol Identifying the Item: L for label, I for Image, 
A for audio, etc. To the right of this are the segment labels In which the 
listed Item appears or from which It Is accessed. 

This cross reference section Is an Invaluable tool for the programer. 
With It he can Immediately locate any of the above listed Items (audio and 
Image print outs) In any part of a course. 

In May of 1971, the DOCUMENT program was revised so that It would print 
out all the audio messages (456) and summary descriptions of all the Images 
(412) In CARE 1. These appear, segment by segment, at the end of the three 
documentation sections of CARE 1. Audio messages are first. In alphabetical 
order, followed by Images In numerical order. 

A more complete write-up of DOCUMENT Is contained In Appendix F. 

Planning Manual . Planning the day-to-day operation of a CAI course like 
CARE 1 Is complicated not only because different educational and technical 
personnel must closely coordinate their activities, but also because many 
operations (e.g.. Image and audio production and deck building) differ widely 
In their completion times. In order to pass on to future CAI course authors 
the experience gained from developing CARE 1, the staff produced a Planning 
Manual . The first part of the Manual Is a modified PERT (Program Evaluation 
and Review Technique) chart designed to Illustrate the events and activities 
required to produce one hour of tutorial CAI. Author time (preparation of 
course content and strategies) Is not Included In the PERT chart. 

The following averages were used to estimate the time required: 

125 author program sheets; 

18 audio messages; 

22 Images; 
155 sectors; and 

3700 Coursewrlter II statements. 

A complete discussion of events, activities, and time development can be 
found In Vol. IV of this Final Report. 

Section Two of the Manual Is a guide for programers and authors of future 
CAI courses. It describes the special programing ''techniques" developed for 



33 



the CARE course, such as answer Identifiers, label and segment schemes, and 
restart points. It was written under the assumption that when experiences are 
documented, valuable time Is saved because errors and Inefficiencies are not 
repeated . 

Handbook . Another form of documentation Is the 400-page Handbook written 
especially for CARE 1 . It Is used by students throughout the course and con- 
tains, among other things, a 350-ltem glossary of critical terms. It has cmo 
functions. First, Its detailed summaries for each chapter are valuable to the 
student as a guide while he takes the course. Second, the Handbook can be used 
as a reference tool and as a comprehensive outline for reviewing course content 
after the course has been completed. It contains charts, records, definitions. 
Images, and a content-related reference at the end of each chapter. 

Syllabus . Another form of CARE 1 documentation Is the Syllabus . The 
Syllabus , Included In this Final Report as Volume III, Is In two sections. 
Section One describes the purpose of the course. Section Two Is an outline of 
course content and objectives. More specifically. Section Two Is a comprehen- 
sive description of the concepts which each teacher must assimilate and use In 
order to carry out the Decision Process. 

Each page of Section Two Is divided Into three columns. The right 
column Is an Integrated description, chapter by chapter, of the course con- 
tent In outline form. The content Is roughly equivalent to Information pre- 
sented by means of the CRT, Images, audio messages, and the Handbook . The 
center column contains the objectives. Objectives are listed each time a stu- 
dent response Is required. In almost every case, an abbreviated description 
of the means for eliciting a student's response accompanies each objective, 
e.g., alt. resp. (alternate response), compl. (completion), mult. ch. (multi- 
ple choice), short ans. (short answer). Internal quizzes are also Inculcated 
(Quiz) as well as review options (Optional Review) and a series of Instruc- 
tional frames presenting Information without requiring Immediate student Inter- 
action (Information Presented). 

The left column lists the modes of presentation: CRT, Image, audio. 
Handbook, and screening devices. When Images are presented In an Instruc- 
tional series, this Is also appropriately noted. 
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CHAPTER V 
EVALUATION 

Evaluation of the CARE 1 course was conducted In two ways. The first was 
contlnjous formative evaluation which took place while the course was being 
developed. Objectives were devised for each chapter of the course, and each 
objective was evaluated using the Lindval (1967), Mager (1962), and Payne 
(1968) criteria. Continuous efforts were made to ensure that course material 
was directly related to the objectives. 

Professional Consultation 

Numerous Informal conferences were held with faculty and staff members 
within The Pennsylvania State University from the following departments or 
programs: Computer Assisted Instruction Laboratory, Department of Special 
Education, Department of Elementary Education, and the Computer Science Depart-* 
ment. These conferences. In concert with the efforts expended by the various 
persons more directly associated with the project, proved to be quite bene* 
ficlal In developing the content and programing for the CARE course. In 
addition to the Penn State consultants, a number of persons were brought In 
from outside the University for consultation on the project. The following 
paragraphs describe the activities of these persons. 

Professor Herbert Quay, Chairman of the Department of Educational Psy* 
chology. Temple University, Philadelphia, Pennsylvania, worked with key staff 
members early In the course of development of the project. Professor Quay 
helped establish the overall philosophy of the course and assisted In the 
development of the Information processing model. 

Professor Ralph Peabody, Department of Special Education and Rehablllta-* 
tlon. University of Pittsburgh, Pennsylvania, was a consultant to the project 
In the area of the visually handicapped. Professor Peabody helped specify the 
content of the cnapter on the visually handicapped and also helped clarify the 
thinking of the Investigators on other more general sections of the CARE course. 
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Mrs. Alma Fandal , University of Colorado Medical Center, Denver, Colorado, 
played a major role In the writing of the chapter on the use of the Denver 
Developmental Screening Tests . 

Professor Steven Hunka, University of Alberta, Edmonton, Alberta, Canada, 
was Instrumental In the development of the documentation of the CARE course. 
His early efforts In developing documentation routines for CAI programs have 
since been expanded by staff at the Penn State CAI Laboratory. 

Formative Evaluation 

The second stage of evaluation began after segments of the course were 
operational. The CARE 1 course was tested by several pilot groups of students. 
Fifteen students took the course In the early summer of 1970, and fifteen stu- 
dents took the course in the late summer of 1970. To maximize the benefit of 
this developmental procedure, a system for recording and revising errors was 
devised. Each student In the first pilot group was accompanied by a proctor 
who recorded on 5 x 8-Inch cards the student's comments and the obvious program 
"bugs." (Bugs Included errors In CRT text, graphic displays. Images, and audio 
messages.) The 5 x 8-Inch cards were then arranged In the correct label 
sequence within segments after being divided according to "concept" revisions 
and "program" revisions. Program revisions went Immediately to the programer. 
Concept revisions were reviewed first by the author and then passed on to the 
programer, often with additional notes. The author also sent the programer 
certain revisions gleaned from a careful study of student responses. When all 
such revisions were collected, the programer revised the course segment by 
segment. The same procedure was followed for the second pilot group, except 
that the students recorded comments without the aid of a proctor. 

In the fall of 1970 two advanced graduate students In special education 
took the course following the same recording procedures. In addition, after 
completing the course, these students each compiled a detailed evaluation of all 
the segments of the course with special emphasis on the objectives and the 
effectiveness with which the objectives were met. 

During October and November of 1970, 115 Inservlce teachers from the 
Clearfield, Pennsylvania area took the course for full credit. Student 



performance records were obtained via the student performance system developed 
by the Penn State CAI Laboratory. The system operates automatically di' ing 
the period that each student Is taking a course and records data such as exact 
responses for each frame and specified course segment, number of requests for 
help during each specified course segment or sub-segment « and response 
latencies. Student response data ara summarized either by student or by 
frame, segment, and course, depending on the wishes of the course author. This 
type of Information Is a valuable aid In locating sections of the course that 
need Improvement and in making appropriate changes. A summary of the student 
performance data from the Clearfield group appears in Appendix G. 

From this pilot group, a total of 85,718 responses was analyzed, and 
extensive revisions were made on the basis of the analysis. 

Summative Evaluation 

During the Winter Term, 1971, a summative evaluation of the CARE 1 pro- 
gram was made. All students who were enrolled in EEC 400, Introduction in 
the Education of Exceptional Children , were randomly assigned to either of two 
conditions— Computer-Assisted Instruction (CAI) or Conventional instruction 
(CI). The CAI group (n » Z7) received all instruction by means of the IBM 
1500 Instructional System and did not attend classes with the CI group. The 
CI group (n « 87) received the conventional lecture-discussion method of 
instruction and met three days per week in 75 minute sessions for ten weeks. 

All students, CAI and CI, were enrolled as regular students for three 
credits of undergraduate or graduate credit. Both the CAI and CI courses were 
designed to reach the same objectives. The instructor of the CI group was an 
author of the CAI course and helped plan the structure and the objectives for 
the CAI course. 

The dependent variables in this investigation were time and final examina- 
tion scores based on 75 items. Results are shown on the following page in 
>F1gure 3. 

These data indicate that the students instructed by CAI obtained a mean 
score of 24% higher on the final examination than did those students instructed 
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Final Examination Scores 

7 S. D. t 

Computer- Ass Is ted Instruction 69.59 4.68 

Conventional Instruction 52.78 5.89 11.65* 

*This difference is statistically significant with p <.001. 

Time 

Computiir-Assisted Instruction J - 25.21 hours per student 

Conventional Instruction 37.5 scheduled hours per student 

Fig. 3. Results of CAI-CI comparative evaluation. 



In the conventional manner. Furthermore, the CAI students completed the three- 
credit course in 12 hours less time (33%) than the conventionally instructed 
students. 

Site Evaluation 

A three-member Site Visit Team from the Bureau of Educational Personnel 
Development observed the program in operation at Its location in Smethport, 
Pennsylvania, on March 10-12, 1971. Excerpts from their report are included 
In Appendix H. 

Adoption b^ the University of Texas 

In the spring of 1971 the course was evaluated by the University of Texas 
Department of Special Education and the University of Texas CAI Center. Twenty 
advanced graduate students In specidl education took the entire course and 
recorded their comments. As a result of this evaluation, the University has 
decided to offer the course to twenty rural educators from El Paso, Texas in 
the summer of 1971. In addition, arrangements are being made to incorporate 
CARE 1 as a regular part of the undergraduate curriculum In special education. 
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Council for exceptional Children 

The Mobile Laboratory with the CARE 1 course was exhibited at the Inter- 
national meeting of the Council for Exceptional Children in Miami Beach, 
Florida. This trip was sponsored by the USOE Bureau of Education for the 
Handicapped and Bureau of Educational Personnel Development. 

The Laboratory was open for Inspection In front of the Fontalnebleau 
Hotel from April 19-23 for approximately twelve hours each day. During this 
period a total of 2,920 persons visited the Laboratory and received printed 
material about the CARE program. It is estimated that 90% of the visitors 
had the opportunity to sit at a student terminal and participate In a portion 
of the course. The records show that 765.5 terminal hours were provided 
during the period. This Is an average of about fifteen minutes for each 
person who took a section of the course. 

The visitors were quite enthused, and most spoke In glowing terms about 
the project. Representative conments are shown In Appendix I. It Is note- 
worthy to note that many of the visitors who began one section of the course 
became Interested enough to return to finish It at a later time. 

Student Opinion Survey (SOS) 

The evalu&tlon of CARE 1 has been both formative and suiranatlve In nature. 
It has been formative In the sense that revisions and modifications have con- 
tinually been made In the course while It has been In the field. This forma- 
tive evaluation has been based on Information gained from the analysis of 
student performance records, final examination subtest scores, student com- 
ments, and the Student Opinion Survey (SOS). 

The Student Opinion Survey Is a 42-1tem questionnaire administered on- 
line following the final examination. The survey deals with statements about 
student attitudes toward computer-assisted instruction, the operation of the 
equipment, likes and dislikes of the course, and student's feelings In general 
about the learning situation. Examples of these questions can be found In 
Appendix J. 

The Student Opinion Sui^vay also serves as part of the summatlve evalua- 
tion of the CARE 1 course. (See Appendices K and L.) 
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Research has shown .hat student attitudes toward the method of Instruc- 
tion may play a significant part In learning and transfer (Gage, 1963). If 
the student has a favorable attitude toward a learning situation, there Is a 
better chance that he will want to learn more about the subject. More Impor- 
tant, a student with a favorable attitude will probably be more Inclined to 
apply what he has learned to the dally situation— In this particular case, the 
elementary classroom. 

The Student Opinion Survey, therefore, plays a significant role In the 
summatlve evaluation of CARE 1 . 

In Its original form, the Student Opinion Survey was a pencil and paper 
questionnaire (Brown, 1966). It has since been adapted to on-line administra- 
tion (Borman, 1969). It has also been modified to allow a student to typ^ 
free response comments after each Item In order to clarify or explain his 
reason for scoring a particular statement high, low, or neutral (Borman, 1969). 

Students evaluate each statement by depressing the light pen along a 
coded line on the cathode ray tube to Indicate the degree to which they agree 

(strongly agree strongly disagree) with a statement or the extent 

that they thought the statement applied (all of the time never). 

Students were told at the beginning of the Student Opinion Survey to be frank 
with their evaluation and comments. 

Student responses were scored on an 8-po1nt scale, with 8 Indicating the 
most favorable attitude and 1 Indicating the least favorable attitude. The 
range of possible scores was from 42 to 336, and a score of 189 would be con- 
sidered the median or a theoretically neutral score. The higher the total 
score the more favorable the student's attitude toward CAI. 

Students could type comments up to 200 characters In length after each of 
the 42 statements In the questionnaire. In addition, at the end of the 42- 
Item questionnaire, the students were given a final opportunity to comment on 
any facets of the CARE 1 course or CAI In general that might not have been 
covered by the SOS Items or that they may have forgotten to record. These com- 
ments were then analyzed as part of a student's total SOS score. In connection 
with the SOS scores, the comments were used as an explanation for extremely 
high or extremely low scores for any particular question or group of questions 
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In the SOS. The comments provided valuable Information tc< the staff with 
reference to possible course modifications or changes In operational procedures. 

A copy of the Student Opinion Survey, along with a breakdown of student's 
responses to each question at each of four locations appears In Appendix J. 
xn addition, student comments are supplied from each location to explain trends 
that might be high, low, or neutral. 
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CHAPTER VI 
SUMMARY 

It was the purpose of this project to develop a complete college level 
computer-assisted Instruction (CAI) course dealing with the Identification of 
handicapping conditions In children. The end produce was a CAI course called 
Computer Assisted Remedial Education (CARE). The purpose of CARE Is to give 
educational personnel the knowledge and skills necessary to deal effectively 
with children who have eoucatlonal problems. Under separate funding arrange- 
ments, the CARE course Is now being offered for three college credits to 
Inservlce teachers In the various parts of Pennsylvania and other states. 

Several stages of development were required to produce the CARE course. 
First, an Intensive revlaw of the relevant literature was carried out In the 
early stages of the project. Approximately 2,000 Journal articles and over 
50 books were reviewed by the various course authors and graduate assistants 
In order to Identify the most current thinking In the field. Subsequent course 
curriculum development was based on the literature review with assistance from 
consultants. As the course authors prepared the sequences of Instruction, the 
educational programers translated the Coursewrlter II language for use with 
the IBM 1500 Instructional System. Both authors and programers tested course 
sequence for smoothness and credibility before a pilot group of students took 
the course for debugging purposes. After the pilot group took the course, 
extensive revisions were made, and a second pilot group assisted In the evalua- 
tion of the CAI program. These pilot groups plus other formative evaluation 
procedures have been Instrumental In producing a CAI course which Is Internally 
valid and error free. 

Summatlve evaluations have shown that students who take the CAI course 
score significantly higher In achievement and take about one third less time 
to cover the same objectives than students Instructed In the conventional 
lecture-discussion method. 
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VEHICLE SPECIFICATIONS 


Unsrii: AVJV 


Overall Exterior wli«n in Tramif. 


Height: 12'-6" 


OvMraH Exl«rior ¥fhM bi Tramit. 


Width: S'-O" 


Overall Exterior whM In Transit. 


CIo*mI: tVA" 


Intid« Width whm in Transit. 


Expan^'^d: 204" (170 


Insid« Widtli whm in Operation. 



FIRE EXTINGUISHER 



PORTABLE STEPS 
WITH HANDRAIL 



in-immDnUnih^ 



FIRE EXTINGUISHER 




PORTABLE STEPS 
WITH PLATFORM 
AND HANDRAIL 



CONTRDL 
PANEL 



r 

r 



APPENDIX B 
Site Locations for Mobile Laboratory 
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APPENDIX C 

Denver Developmenttl Screening Test Form 



1. 

2. 
3. 

k. 

5. 
6. 

7. 
8. 



DATE 
NAME 

BIRTHDATE 
HOSP. NO. 



Try to get child to smile by smiling, taU^ing or waving to him. Do not touch him. 
When child is playing with toy, pull it away from him. Pass if he resists. 
Child does not have to be able to tie shoes or button in the back. 
Move yarn slowly in an arc from one side to the other, about 6" above child's face. 
Pass if eyes follow 90'' to midline. (Past rrddline; I80'' ) 

Pass if child grasps rattle when it is touched to the backs or tips of fingers. 

Pass if child continues to look where yarn disappeared or tries to see where it went. Yarn 

should be dropped quickly from sight from tester's hand without arm movement. 

Pass if child picks up raisin with any part of thumb and a finger. 

Pass if child picks up raisin with the ends of thumb and index finger using an over hand 
appice?h. 




13. 
11+ . 



15. 

16. 

17. 

18 • 
19- 

20. 

21 • 
22. 

23- 
2h. 

25. 
26. 

27. 

28- 

DATE 



Pass any en- 
closed form. 
Fail continuous 
round motions. 



10. Which line is longer? 
(Hot bigger.) Turn 
paper upside down and 
repeat. (3/3 or 5/6) 



11. Pass any 12. Have child copy 

crossing first. If failed, 

lines. demonstrate 



Whci giving items 9} U- and 12, do not name the forms. Do not demonstrate 9 and 11. 

When scoring, each pair (2 arms, 2 legs, etc.) counts as one part. 

Point to picture and have child name it. (No credit is given for sounds only.) 







Pass 2 of 3. 



Tell child to: Give block to Mommie; put block on table; put block on floor. 
(Do not help child by pointing, moving head or eyes.) 
Ask child: What do you do when you are cold? ..hungry? ..tired? Pass 2 of 3. 
Tell child to: Put block on table; under table; in front of chair, behind chair. 
Pass 3 of k. (Do not help child by pointing, moving head or eyes.) 

Ask child: If fire is hot, ice is ?; Mother is a woman. Dad is a ?; a horse is big, a 
moase is ?. Pass 2 of 3. 

Ask child: What is a ball? ..lake? ..desk? ..house? ..banana? ..curtain? ..ceiling? 
..hedge? ..pavement? Pass if defined in terms of use, shape, what it is made of or general 
category (such as banana is fruit, not just yellow). PasL 6 of 9. 
Ask child: What is a spoon made of? ..a shoe made of? 
may be substituted.) Pass 3 of 3. 



..a door made of? (No other objects 



span 



When placed on stonach, child lifts chest off table with support of forearms and/or hands. 

When child is on back, grasp his hands and pull him to sitting. Pass if head does not hang back. 

Child may use wall or rail only, not person. May not crawl. 

Child must throw ball overhand 3 feet to within arm*s reach of tester. 

Child must perform standing broad jump over width of test sheet. (8-1/2 inches) 

Tel^ child to walk forward, oOa=DcaOCQ->- heel within 1 inch of toe. 

Tes er may demonstrate. Child must walk k consecutive steps, 2 out of 3 trials. 

Boui.ce ball to child who should stand 3 feet away from tester. Child must catch ball with 

hands, not arms, 2 out of 3 trials. 

Tell child to walk backward, -^COcqcOOO toe within 1 inch of heel. 
Tester may demonstrate. Child must walk k consecutive steps, 2 out of 3 trials. 

AND BEHAVIORAL OBSERVATiqjS (how child feels at time of test, relation to tester, attention 
, verbal behavior, self-confidence, etc,): 
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APPENDIX E 

Interior and Exterior Views of the Mobile Laboratory 
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DOCUMENT: 

A System for the Documentation of CAI Courses 

In the field of computer-assisted Instruction, there Is a growing concern 
about the need for effective course documentation. With the Increase In the 
number and soph'' itl cation of developed courses, dissemination of Information 
on content and strategies becomes more necessary. One result of the lack of 
good documentation Is needless duplication. Instead of using already existing 
courses, many developer? go through the tedious process of building a new 
course from the ground up. 

If a documentation system Is to perform Its function effectively. It must 
be suitable for several distinct audiences. In The Pennsylvania State Unl- 
versry's DOCUMENT system, essential Information concerning the content and 
strategies of a course Is made available to potential consumers, course pro- 
gramers, non-programers, and Instructors. Each of these groups places differ- 
ent demands upon the documentor, and only when all of these demands can be met 
Is a documentation program functional. Penn State's DOCUMENT confronts each 
of these levels, seeking to provide Information of maximum value to all four 
audiences. 

The first audience, the potential consumer. Is made up of those concerned 
with the events taking place at other CAI facilities and Interested In 
obtaining useful courses. Since the dissemination of courses presents a 
problem, as dees the compatibility to a variety of machine configurations, 
models, end languages, potential consumers are reluctant to expend the time 
and effort to obtain courses from other Installations. This constrains wide- 
spread use of an already developed course. 

It Is In solving this problem that printeu documentation can be of value. 
For potential consumers, printed documentation provides a concise and accurate 
description of a course and may be consulted without special equipment or 
technical knowledge. Using this description, a potential consumer can deter- 
mine the merits and drawbacks of a course and can judge whether or not the 
course Is suitable for his own Installation. 
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The first section of course documentation produced by DOCUMENT, which Is 
a transformation of Coursewrlter II code Into an understandable English repre- 
*w.itat1on of the course. Is Important for both programers and non-programers. 
The format consists of a representation of the CRT screen display together 
with a description of how student answers are processed. Each new screen 
display, with Its label and any pauses used. Is also presented. 

In Figure 4, the screen display labeled A054HM Is presented after a half- 
second pause. * Rows and columns are numbered to serve as points of reference. 
The apostrophes over "a," "b," and "c" In the answer choices indicate that 
these three letters are alternate-coded. (Alternate coded characters appear 
as dark characters on a light background on a cathode ray tube.) Below the 
screen display, DOCUMENT lists the type of response required from the student 
and the amount of time allowed for an answer to be submitted. (In Figure 4, a 
light pen response Is required, with the amount of time being determined by 
the system latency time previously established. The course program then calls 
for 4 rows to be erased to leave room for feedback to the student. A one- 
half second pause follows.) 

In Figure 4, "a" Is the correct answer, and the lines "RIGHT. + .86 IS 
NEAR -I- 1.0, SO IT IS HIGH AND IT IS POSITIVE" are displayed In the feedback 
area previously cleared on the screen. The student then moves to the next 
frame. Answers "b" and "c" are WRONG ANSWERS, and the feedback for each 
answer Is Indicated. After the feedback, the program returns the student to 
the original question. If the student has not given any of these three 
arrwers, he gets the feedback response for an "unrecognizable answer." The 
program then reverts to the original question position, and the student Is 
ready to answer again. 

In addition to the material In Figure 4, other features are Included In 
the DOCUMENT system. The use of audio Is Indicated by a message such as "PLAY 
AUDIO MESSAGE AAAAA," where AAAAA Is the symbolic audio name. If an emphasis 
mark Is Included, the message "CONTINUE AUDIO MESSAGE AAAAA" Is printed. If 
the audio uses an absolute address Instead of symbolic, then AAAAA Is replaced 
by the constant symbol ABSOL. The use of film Images Is shown by several 
messages which Indicate the opening and closing of the shutter, the positioning 
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of the f11m» and the number of the frame to be displayed. Branches are shown 
by a message "GO TO LLLLL" where LLLLL Is the label In the course to which 
control Is passed. If a condition must be present for a branch to take p1ace» 
It Is Indicated by a message such as "GO TO LLLLL IF COUNTER NN IS EQUAL TO 
XXX," where NN Is the counter number and XXX Is the value which is being tested 
for. This section of DOCUMENT offers both the programer and non-programer a 
sequential and graphical representation of a course. 

The second part of DOCUMENT, as shown In Figure 5, Is a listing of the 
actual Coursewrlter II statements. The headings on each page Include course 
name and segment* date and time of day of the DOCUMENT run» and pagination. 
For example. In Figure 5, the course CARE 1 segment 11 was run through DOCUMENT 
at 24 seconds past 7:18 a.m. on January 17, 1971. The body of the page, from 
left to right, contains a sequential count of all Input Coursewrlter state- 
ments, the label -sequence number of each statement, and a reproduction of the 
Input card or cards associated with each statement. For example. In Figure 5, 
statement ni»nber 1396 corresponds to the 1396th Coursewrlter statement on the 
Input cards with a label -sequence number of A054IC-7. The Coursewrlter state- 
ment DE 0>/32 results In a complete clearing of the display screen. This 
listing can thus be used In conjunction with the graphic display of the course 
to make modifications and to visualize how a display will be observed by the 
student. By cross-referencing between a label on the course listing and the 
frame labels In the granhic section, the programer can find the correspondence 
between the Coursewrlter code and the graphic representation. 

The third part of DOCUMENT, which Is also of Interest to the programer, is 
a cross-referenced table Illustrating which audio, buffers, counters, functions, 
film Images, labels, macros, return registers, switches, and counters used as 
switches have been used and where they have been used. In the case of labels, 
this part of DOCUMENT Indicates where they have been defined The format for 
this table produces, from left to right, the symbol of the Item to be cross- 
referenced followed by a one-letter code to Identify the type of symbol. In 
the case of labels only, the statement number which corresponds to the location 
where the label was defined Is listed next. Then, in all cases, the next ten 
columns contain the label -sequence number of all statements In the course In 
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which the symbol at the left was used« Figure 6 contains an illustration. In 
this case» llprlO Is a label defined in statement number 310 and referenced 
at only one other point In the course, namely PROCES-25. PSADD1 , on the other 
hand. Is a macro which Is referenced In 101 locations in the course. 

This cross-referenced table has several levels of ordering. First, each 
category of symbols Is grouped together. Then, within each group, the symbols 
themselves are ordered alphabetically, with the label -sequence numbers also 
alphabetically ordered within each symbol. 

A documentation system Is also a useful aid to an instructor in the pre- 
paration of material to be used In teaching a conventional course In the same 
or related subject matter. In effect, the system presents the Instructor with 
a course outline, contents, questions, and exams. On this basis, the Instruc- 
tor may then modify, extend, or accept the material without taking the time 
and energy to find and organize the material from the beginning. 

DOCUMENT Is programed In PL/1 for an IBM System 360/67. However, the 
program was designed so that It would be compatible with any 360 system con- 
taining a standard PL/1 compiler. This provides for the use of DOCUMENT in a 
large number of Installations. Work on the original documentation system was 
begun by Richard Thompson In January 1970. The branching logic, which the 
system accepts, was added by Fred Chase In April 1970. The present version of 
the system was developed during the fall of 1970. It Includes such things as 
a conversion of output Into upper and lower case, an allowance for more than 
one course to be processed In a single computer run, the addition of a symbol 
cross-reference listing, and a decrease in the amount of time required to 
execute the program. 

The DOCUMENT system requires the use of several Input/output devices. 
Input to the system may come In the form of punched cards or magnetic tape, 
with the number of courses or segments which can be processed at a single time 
limited only by the amount of time and records available at the computer 
Installation. There Is no limit to the number of statements In the course to 
ue documented. 

There are two distinct sets of output produced by the DOCUMENT system. 
The first two sets are tape output. One tape Is used to contain the graphic 
document output, with one tape file containing each documented section. The 
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second tape Is used to contain the course listing and cross-referenced table, 
again with one tape file containing each documented section. This splits the 
output necessary for both programers and non-programers. A listing of the 
appropriate tape» therefore, need only result In the output for the required 
group. 

Several temporary disk storage areas are required for the sorting pro- 
cedure* which Is iccompllshed by the standard IBM SORT MERGE program. The 
DOCUMENT system Is currently In active use at Penn State. Presently, the cost 
for documenting a course Is approximately 1.16^ per Coursewrlter II statement. 
The exact cost Is Installation-variable but should remain In close proximity 
to the above figure. The amount of output In terms of lines printed can be 
approximated by the formula 6.8 times the number of Coursewrlter statements. 
This figure Is based on a complete listing of the three sections of documenta- 
tion (graphic documentation, coursewrlter listings, and cross-reference) • 

The DOCUMENT system offers a variety of Information to all users, and 
this Information Is presented In readable, easily Interpreted form. Always 
dlynamlc In nature, however, DOCUMENT can look forward to greater refinements 
In the future. Anticipated revision!^ Include such additions as a copy of the 
actual text In audio messages and a decrease In the amount of time required 
for each Coursewrlter statement. In the meantime, DOCUMENT Is an efficiently 
operating system producing a unique analysis of Coursewrlter II code. 




Pfg. 4. Screerr di^lcy presented sfter a half-second pause. 
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Table 1 



Performance Records 
Interactions from Clearfield 













Average 




Possible 


Total Number 


Mean Number 


Completion 


Segment No. 


Interactions 


Of Attempts 


Of Attempts 


Time (in hours} 


3 


3 


206 


1.08 


3.24 


1.2 


30 


34 


4066 


1.43 


48.62 


.6 


33 


5 


574 


1 .26 


6.30 


.4 


10 


31 


3877 


1.40 


43.40 


1.1 


20 


7 


833 


1.11 


7.77 


.4 


40 


55 


7111 


1 .22 


67.10 


1.0 


42 


16 


2039 


1 .24 


19.84 


.6 


46 


31 


3737 


1.20 


37.20 


1.0 


52 


38 


4117 


1.25 


47.50 


1.5 


53 


40 


4527 


1.22 


48.80 


.2 


60 


28 


3304 


1.47 


41 .16 


1.6 


61 


11 


2076 


2.25 


24.75 


.2 


62 


3 


248 


1.02 


3.06 


.0 


63 


21 


1239 


1.04 


21 .84 


.1 


64 


46 


202 


1.04 


47.84 


.2 


65 


20 


1728 


1.18 


23.60 


.5 


70 


3 


223 


1.09 


3.27 


.1 


71 


21 


1718 


1 .25 


26.25 


1.7 


80 


35 


2405 


1.09 


38.15 


.9 


81 


25 


2099 




36.50 


.1 


92 


27 


1743 


1.21 


32.67 


1.3 


6 


9 


COO 

599 


1.25 


11.25 


.c 


4 


65 


4886 


1.65 


107.25 


2.0 


5 


59 




1.63 


96.17 


2.1 


7 


36 


1796 


1.19 


42.84 


.1 


11 


65 


3552 


1.22 


79.30 


.3 


12 


41 


3004 


1.23 


50.43 


1.3 


41 


50 


4356 


1.45 


72.50 


2.1 


23 


42 


2904 


1.13 


47.46 


5 


24 


40 


3216 


1.23 


49.20 


1.4 


96 


17 


1253 


1.24 


21 .08 


.5 


100 


44 


2231 


1.66 


73.04 


.5 


101 


43 


2039 


1.16 


49.88 


.5 


102 


75 


4590 


1.24 


93.00 


.5 


105 Summary: 


No Interaction 








.1 


120 EXAM 










1.0 


127 Sign-Off Transfer 










Totals 


vsse 


WVS 




1422.26 




Means 


31.94 


2521 .12 




41 .83 



Table 2 



Summary of Coursewriter Statements 
by Segment - Clearfield Data 



Number of 

Segment Number Statements 



0 


2869 


3 


1120 


30 


2947 


33 


731 


10 


2746 


20 


1083 


40 


4833 


42 


1468 


46 


2636 


52 


3003 


53 


2912 


60 


2147 


61 


900 


62 


438 


63 


1984 


64 


2542 


Q9 




70 


756 


71 


3286 


80 


3671 


81 


2852 


92 


2297 


6 


813 


4 


2721 


5 


3342 


7 


3954 


11 


4431 


12 


3607 


41 


3689 


23 


2675 


24 


2352 


96 


1815 


100 


2735 


101 


2538 


102 


4576 


105 (no Interaction) 


342 


120 EXAM 


6237 


127 Sign-Off 




Total 


95.375 



Table 3 



Numbers of Labels, Audio Messages, 
and Images by Segment - Clearfield Data 



Segment 


Number of 


Number of 


Number of 


Number 


Labels 


Audio Messages 


Images 



0 


36 


n 


12 


= 12 


3 


42 


7 


13 + 


1 ' 14 


30 


103 


14 


28 + 


5 = 33 


33 


19 


7 


1 + 


1 = 2 


10 


99 


0 


19 + 


4 « 23 


20 


35 


7 


8 + 


10 » 18 


40 


146 


24 


25 + 


n = 36 


42 


42 


21 


14 + 


2 « 16 


46 


80 


26 


6 + 


1 » 7 


52 


83 


9 


18 + 


2 » 20 


S3 


92 


17 


8 + 


3 ' 11 


60 


105 


9 


17 + 


6 » 23 


61 


47 


4 


6 


» 6 


62 


16 


4 


5 + 


3 « 8 


63 


57 


1 


6 + 


1 - 7 


64 


105 


8 


18 + 


4 » 24 


65 


79 


9 


29 + 


3 « 32 


70 


31 


] 


3 


» 3 


71 


123 


21 


7 + 


5 « 12 


80 


138 


8 


15 + 


1 - 16 


81 


115 


7 


0 


= 0 


92 


74 


22 


26 + 


3 « 29 


6 


27 


1 


5 + 


1 « 6 


4 


83 


4 


9 + 


4 « 13 


5 


95 


6 


10 + 


2 » 12 


7 


104 


79 


13 + 


3-16 


11 


231 


0 


37 + 


3 = 40 


12 


91 


13 


18 + 


3-21 


41 


83 


25 


24 + 


4-28 


23 


74 


31 


1 


- 1 


24 


53 


26 


0 


- 0 


96 


49 


28 


3 


- 3 


100 


96 


7 


5 + 


5-10 


101 


79 


1 


2 + 


6-8 


102 


140 


1 


1 + 


4-5 


105 


13 


0 


0 


» 0 


120 


80 


0 


0 


» 0 


127 


2 


0 


0 


- 0 


Total s 


2965 


456 


412 +103 « 515 
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APPENDIX H 
Reactions of Site Visit Team 



Report of Bureau of Educational ^^rsonnel 
Development Site Visit Teuin 

Reactions to CARE 1 



The following paragraphs are taken verbatim from the report of a Bureau 
of Educational Personnel Development Site Visit Teamo The paragraphs most 
relevant to this report are Included here; other paragraphs dealt primarily 
with administrative Issues and budget matters. 

To what extent does the project have a clear and substantive scholarly base? 
Obviously bulld6 on a vMt 6toKZ oi tzchnotoglcat and fAychotoglcjat 

thz content o^ tkt CAI pnognm. 

Has the project benefited from the active Involvement of scholars of the host 
institution and elsewhere? If so» describe. 

ThzKz cjonAldzAobtt eutdence oi viidz invotvanznt thz 
ioUouiing gMup6: CAI Labcxatc^ ^ta^i, Spzclal Edacation 6taU 
0^ thz ContimiinQ Education Division ol Pznn Statt. Voaajoua cx>n- 
tacti and coJUabo^tlvt zUoAtA havz been e^tabtUh^.d mXh C. E. C. 
Convention ^ta^i. Special Education VepoAtment at Pitt, CAI Labona- 
toAjf at UniveMiJy oi Tzxoa, and the ^ta^i oi vaxiou^ itdznal 
aaenciu. Ml cantact^ have nuultzd In ^pecX^c mnkinQ MJlation- 
6nip6 in dzvcJtopment and di^^mination activitit^. 

General comments and Impressions of the Site Team on cirri culum: 

Tkii i^ an otvUtanding pnototypz project vohich nkUntaint a ca/ie- 
iuJUy conceived tAoining sequence uniquely applicable to the 
populations sensed. Tke cju/uUailm content, essentially developed 
undvi a sepoAote gn,cuU inom S. E. H., u excellent and should be 
diM/ubuted uUAely to teachcA education pnognoM . 

General comments and Impressions of site visitors on Instructional resources. 

Tfie inAtAuctional Kesoa/ices ion. this project one cleaAly excjzUent. 
They nziJUct coAe^ul planning and Integnatlon oi the component 
iajcetA o\ tiie total pwjectc TheAe is, houteveA, a cZeax need ion, 
hie developoient oi addUional soitmAe contponenti. It is ovjl 
imdeAStanding that a second pnognam on nemediation techniques ion. 
the KeguloA class teachcA is being pnoposed. The team encouAagts 
the development oi such an instructional pnognm. It mold be 
oi iuAtheJi value to encoanage the pnoject staH to develop a 
masteA plan on. model ion. the developrrent oi iutu/ie soi^MOJie 
packages compatible caZtfi the systm they have developed. 
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General comments and Impressions of site visitors on the present and potential 
outcome of the project: 

CAI couA^t to zZmtntoAy school te/ichoM in nu/uil a/izcu thz 
6tcutt. AppKoximattty 700 tzachoM in tho. 6tatt voiJU kavz com- 
pttttd tht couMt u a Kt^utt oi p^/ect e^|{aA^. 

Tfie potzntiat oiUcom^ oaq. tunitzd only by a.) dojnomtAaZzd ao^t/ 
mtctiventS6 o^ thz cau/L6e, b) availctbitUy o^ additional ^o^t- 
u)aAt packagt^, c) iutuAz Randal 6uppo^ iox 6oiti^)aAZ davatop- 
mznt, evaluation, du^emination- adoption activitiUo 

General comments of the Site Visit Team: 

Tku i6 an outstanding zxamptz o^ hou) significant cont/Ubution^ 
to the iictd may be aacompti&hcd. Thz softi/ooAz pKognxm (CARE 
couAJbz] u;a6 developed by a g^oup of Special Educatou undo/!. 
B. E. H. contJiacl suppo^o Once developed, the E. P. V. A. 
pKojecJt \^as proposed as a means foK utilizing and deHvening 
the couAse to teacher t/ialnezs. It appeoAS that the logical 
next step i6 to obtain a ccmpAehensive analysis of the effects 
of the couAse on teacheA behavioA, a deXailed cost/ effectiveness 
and evaluation in conjunction voLth a plan foA dl^SQmnation and 
adoption of the pAoject, and a cx>mpAehensive plan foA develop- 
ment of futuAe soft^oAe pAogAam ^.n Special Education* 



APPENDIX I 
Comments from CEC Convention 
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Comments from CEC Convention 
Miami Beach, Florida 
April 19-23. 1971 



It was a very good learning experience. The machine worked at my speed. I 
enjoyed using It. 

Appears to have potential for concentrated Inservlce training of teachers 
where time Is a factor. 

How about underlining technical terms when Introduced? or (IT)? 

I am really impressed with this Instructional technique. I can see the value 
of Its use In a county such as mine; that Is, a small rural one removed from 
a university setting. The Inservlce value would be great. 

Feedback for answer was not appropriate. Should be revised. 

I like the Idea of Immediate reward. 

I have attempted to illustrate this concept to rqy classes. This approach seems 
to be a most effective way of lllustratlfig this most basic tenet of special 
education. 

I didn't spell appetite correctly and It didn't accept It. 

What a fantastic machine. I tried to fool It several times or at least to 
confuse It but I failed. I think the positive comments that are In the answer 
checks are good for reinforcing the person taking the course. I felt that the 
machine was friendly because of the personal tone of the comments. 

Previous question should have considered the term eyes. 

I feei the need for human Interaction with people when I learn about emotion- 
ally disturbed children. I learned some things and I believe that the system 
Is excellent . . . thanks for the demo. 

I find the light source hard on the eyes and after a time wy e^yes start to 
jump. As for the Information that one Is supposed to be acquiring, it Is not 
reinforced soon enough In time or sequence. 

I think this Is a fantastic program not only for the teacher but almost as 
Important for the layman who has had no experience with this problem. It 
helps him become a little more aware. 

Wish there was a way to speed It up. Felt n\y attention lagging. 
This Is the most Impressive thing I've seen at a convention. 
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Number 3 not enough ^'nfonnation to make a decision. 

I think that the program Is very good and has great possibilities in under- 
privileged areas where students cannot afford to attend regular classes. 
I hope to see It spreading all over tne nation soon, 

I don't think that's a fair question. Which developmental period Is referred 
to: during pregnancy? environmental? 

I think this Is a well organized course for teachers^ It Is a most unique 
way of presenting material to the teacher of children with learning problems. 

Very Impressed by the concept. Also was very happy that the tests FGST, BDST, 
and MRT were explained to teachers. I feel this Is one area that teachers 
need more Information— test Interpretation. 

It has not been proven to any satisfactory results that the answer given to this 
particular question Is true. In fact It has been found that retardation or a 
retarded child can come from any type of background due to the many factors 
involved, e.g., brain damage. 

1. sound and word pictures should be kept identical and together 

2. very excellent idea and should be used in the teachers colleges 
to aid in educational instruction 

This program should be available to all training programs in the vision 
program. 

Keywording does not detect first letter missingo That's quite the thing 
though. 

The chapter seemed quite complete for an introductory deaf education and 
certainly brought to light several important facts that all teachers should be 
aware of a The van Is amazing and found It extremely enjoyable. 

I would be very Interested In more Information concerning your computer program 
and how adaptable It would be for a classroom situation. This Is tny first 
experience with a computer program and I enjoyed It very mucho It is 
fantastic for instant reinforcement and Individualized Instruction— too bad it 
costs so muche Thank yoUo 



APPENDIX J 



Student Opinion Survey and Statistical Surnmary of SOS 
Statements from Four Sites, with Representative Comments 
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In order to help the reader of this report better understand the SOS 
scores, the Student Opinion Survey has been divided Into individual statements. 
Following each statement Is a chart containing a summary of the students' 
responses from each location. The percentage of students who rated the state- 
ment at each point along the 8 point scale Is given. 

Below each chart are representative comments from the students at the 
various locations. The comments may help to explain the ratlngi In the chart. 
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STUDENT OPINION TOWARD COMPUTER-ASSISTED INSTRUCTION 



1. The method by which I was told whether I had given a right or wrong 
answer became monotonous. 



Strongly 
Disagree 



Disagree 



Uncertain 



Agree 



Strongly 
Agree 



2. Nobody really cared whether I learned the course material or not. 



Strongly 
Disagree 



Disagree 



Uncertain 



3. I felt challenged to do niy best work. 

Strongly Disagree Uncertain 
Disagree 

4. I felt Isolated and alone. 



All the 
time 



Most of 
the time 



Some of 
the time 



Agree 



Agree 



Very 
Seldom 



Strongly 
Agree 



Strongly 
Agree 



Never 



5. I fell as If someone were engaged In conversation with me. 



All the 
time 



Most of 
the time 



Some of 
the time 



Very 
Seldom 



Never 



6. As a result of having studied by this method^ I am Interested In 
learning more about the subject matter. 



Strongly 
Disagree 



Disagree 



Uncertain 



Agree 



Strongly 
Aaree 



7. I was more Involved in operating the terminal than In understanding 
the course material . 



All the 
time 



Most of 
the time 



8. The learning was too mechanical. 



Strongly 
Disagree 



Disagree 



Some of 
the time 



Uncertain 



9. I felt as If I had a private tutor. 

Strongly Disagree Uncertain 
Disagree 



Very 
Seldom 



Agree 



Agree 



Never 



Strongly 
Agree 



Strongly 
Agree 
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10. The equipment made it difficult to concentrate on the course material. 

All the Most of Some of Very Never 

time the time the time Seldom 

11. The situation made me quite tense , 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

12. Computer-assisted instruction, as used in this course, is an inefficient 
use of the student's time. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

13. ffy feeling toward the course material after I had completed the course 
was favorable. 

Strongly Disagree Uncertain Agree Strongly 

Disagree Agree 

14. I felt frustrated by the situation. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

15. I found the computer-assisted Instruction approach in t.his course to be 
inflexible. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

16. Material which is otherwise interesting can be boring when presented by 
CAI. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

17. I was satisfied with what I learned while taking the course. 

' Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

18. In view of the amount I learned, this method seems superior to classroom 
instruction for many courses. ^ 

Strongly Disagr**** Uncertain Agree Strongly 
Disagree Agree 
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19. I would prefer computer-assisted Instruction to traditional Instruction. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

20. Computer-assisted instruction Is just another step toward de-personalized 
Instruction. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

21. I was concerned that I might not be understanding the material. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

22. The responses to my answers seemed appropriate. 

All the Most of Some of Very Never 

time the time the time Seldom 

23. I felt uncertain as to my performance in the programed course relative to 
the performance of others. 

All the Most of Some of Very Never 

time the time the time Seldom 

24. I was not concerned when I missed a question because nobody was watching 
me. 

Strongly Disagr. ! Uncertain Agree Strongly 
Disagree Agree 

25. I found inyself trying to get through the material rather than trying to 
learn. 

All the Most of Some of Very Never 

time the time the time Seldom 

26. I knew whether R\y answer was right or wrong before I was told. 

All the Most of Some of Very Never 

time the time the time Seldom 

27. In a situation where I am trying to learn something, it is Important to 
me to know where I stand relative to others. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 
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28. I guessed at the answers to some questions. 

All the Most of Some of Very Never 

time the time the time Seldom 

29. I was aware of efforts to suit the material specifically to me. 

All the Most of Some of Very Never 

time the time the time Seldom 

30. I was encouraged by the responses given to niy answers to questions. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

31. In view of the time allowed for learning, I felt too much material was 
presented. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

32. I entered wrong answers In order to get more Information from the 
machine. 

All the Most of Some of Very Never 

time the time the time Seldom 

33. I felt I could work at iqy own pace. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

34. Questions were asked which I felt were not related to the material 
presented. 

All the Most of Some of Very Never 

time the time the time Seldom 

3&. I was aware of the flickering screen while I was taking the course. 

All the Most of - Some of Very Never 

time the time the time Seldom 

36. Material which Is otherwise boring can be Interesting when presented by 
CAI. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 



99 



37. I could have learned more If I hadn't felt pushed. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

38. I was given answers but still did not understand the questions. 

All the Most of Some of Very Never 

time the time the time Seldom 

39. The course material was presented too slowly. 

All the Most of Some of Very Never 

time the time the time Seldom 

40. The responses to iqy answers seemed to take Into account the difficulty of 
the question. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

41. While on computer-assisted Instruction, I encountered mechanical malfunc- 
tions. 

All the Most of Some of Very Never 

time the time the time Seldom 

42. Computer-assisted Instruction did not make It possible for me to learn 
quickly. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 
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1. The method by which I was told whether I had given a right or wrong 
answer became monotonous. 



Location 



Frequency In Percentage 



Clearfield (N=90) 


36.67 


21.11 


8.89 


8.89 


4.44 


7.78 


5.56 


Ridgway (N»118) 


44.07 


20.34 


11.86 


4.24 


3.39 


7.63 


4.24 


Penn State (N=27) 


40.74 


14.81 


11.11 


3.70 


7.41 


7.41 


14.81 


Smethport (N>108) 


50.00 


20.37 


6.48 


4.63 


3.70 


7.41 


2.78 



Strongly 
Disagree— 
8 7 



6.67 
4.24 
0.00 
4.63 

Strongly 
—-Agree 
2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



Although It was somewhat monotonous It was beneficial 
In most cases because It helped me to use the proper 
terminology which I believe Is essential to the mate- 
rial of the course. 

I expected to sec- ri\y first name used more often. When 
using the light pen the right answers would not always 
enter. 

I thought It was a vary motivating method. Including 
an explanation of why I was right or wrong. This 
method helped me to learn more about what I was 
studying and It increased iry understanding. 

The feedback was very helpful. 
It gave good reasoning. 

I felt the Immediate reinforcement greatly enhanced 
the understanding of the concepts In the course. 



101 



2. Nobody really cared whether I learned the course material or not. 



Location Frequency In^ Percentage 



Clearfield (N=90) 


56.67 


7.78 


5.56 


10.00 


2.22 


7.78 


2.22 


7.78 


Ridgway (N»118) 


44.07 


20.34 


11.86 


4.24 


3.39 


7.63 


4.24 


4.24 


Penn State (N«27) 


70.37 


18.52 


11.11 


0.00 


0.00 


0.00 


0.00 


0.00 


Smethport (N«108) 


39.81 


19.44 


9.26 


8.33 


.93 


4.63 


4.63 


12.96 



Strongly Strongly 

Disagree Agree 

8 7 6 5 4 3 2 1 



Clearfield 



Ridgway 
Penn State 



Smethport 



Seemingly the computer did not care If you learned or 
not. But the fact that people took the time to work 
out this system of study and are continually trying to 
Improve the course leads one to think somewhat the 
opposite. 

I got out of the course what I put Into It. I cared. 

The enthusiasm of the staff was very Influential in 
maintaining interest. Seeing i^y name used occa- 
sionally made the course more personalized and enjoy- 
able. 

It need not be important to anyone else but for iny own 
Information. 

Personal motivation is a sure sign of maturity. 
I cared. 
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3. I felt challenged to do my best work. 



Location 

Clearfield (N«90) 
Ridgway (N-118) 
Penn State {N«27) 
Smethport (N>108) 



Frequency Vn Percentage 



16.67 
11.02 
11.11 
1.85 

Strongly 
Disagree 
1 



4.44 


5.56 


5.56 


4.44 


16.67 


14.44 32.22 


0.00 


5.93 


10.17 


5.93 


16.95 


16.95 33.05 


3.70 


3.70 


3.70 


3.70 


25.93 


18.52 26.63 


2.78 


5.56 


6.48 


10.19 


18.52 


22.22 32.41 












Strongly 



—Agree 
7 8 



Clearfield 

Ridgway 
Penn State 



Smethport 



I did ac times, but sometimes the material was not 
Interesting enough to warrant my best efforts. I found 
inyself not really listening, for example, to the audio 
messages. 

You are working at your own speed and at your own level. 
This for me was an Incentive to do n^^ best. 

I felt I had to keep up in order to answer the questions 
and understand the material . 

This is the first course I have taken in six terms in 
which I had n\y reading done before I began studying a 
particular section. 

There was little time and thus did not feel I had the 
time to study between classes. 

I did not feel like I was competing against anyone but 
inyself . 



4. I felt Isolated and alone. 
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Location 






Frequency in Percentage 






Clearfield (N=90) 


4.44 


1.11 


1.11 


5.56 


7.78 13.33 


10.00 


56.67 


Ridgway (N»118) 


.85 


1.69 


2.54 


5.08 


3.39 11.02 


12.71 


62.71 


Penn State (N=27) 


0.00 


0.00 


7.41 


7.41 


7.41 11.11 


18.52 


48.15 


Smethport (N>108) 


0.00 


2.78 


3.70 


7.41 


6.48 8.3j 


1.11 


60.19 




All the 































1 



8 



Clearfield 
Ridgway 

Penn State 



The proctors were very willing to help unmuddle any 
messes I created with your circuits. 

I felt the computer was alive. 

There was a friendly atmosphere here. 

There were always new people to meet at the class and 

the proctors and men In charge were very friendly. 

I was frustrated by the absence of opportunity to 

discuss a point or a wrong answer. 

To me the computer represented not just one teacher 

nor being alone but a whole team of people who really 

cared. 



Smethport 



The proctors were always ready and willing to help 
whenever needed. 
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5. I felt as 1f someone were engaged In conversation with me. 



Location Frequency 1r[ Percentage 



Clearfield (N»90) 


22.22 


17.78 


15.56 


12.22 


12.22 


5.56 


5.56 


8.89 


Ridgway (N»118) 


22.03 


18.64 


18.64 


11.86 


7.63 


5.93 


4.24 


11.02 


Penn State (N»27) 


18.52 


11.11 


29.63 


7.41 


7.41 


7.41 


7.41 


11.11 


Smethport (N»108) 


30.56 


24.07 


13.89 


15.74 


3.70 


4.63 


1.85 


5.56 



All the 

Time Never 

8 7 6 5 4 3 2 1 



Clearfield 
Ridgway 



Penn State 



Smethport 



The conversation was one-sided. I think that a change 
In voices on the audio messagivs would be good. 

At times the computer seemed to have a personality. 
Some of the taping really seemed like a dialogue. 
Thank you for the humor that you used In programing 
the material. It made me feel as though you people 
really cared about us. 

At times I didn't understand and would have liked 
further answers and responses to questions. I felt 
like It was more a conversation with niyself. 

Computer use of names seemed personal . 
Warm and friendly atmosphere. 

I liked this feeling. I have be^.n to think there Is 
a little man sitting Inside this CRT. Weird, huh? 
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6. As a result of having studied by this method » I am Interested In learning 
more about the subject matter. 



Location Frequency In^ Percentage 



Clearfield (N=90) 


7.76 


2.22 


3.33 


5.56 


5.56 


15.56 


18.89 


41.77 


Ridgway (N»118) 


6.78 


5.08 


5.08 


9.32 


4.24 


16.95 


18.64 


33.90 


Penn State (N=27) 


COO 


7.41 


3.70 


7.41 


7.41 


7.41 


29.63 


37.04 


Smethport (N=108) 


4.63 


2.78 


1.85 


5.56 


9.26 


19.44 


10.19 


46.30 



Strongly Strongly 

Disagree Agree 

1 2 3 4 5 6 7 8 



Clearfield I hope that additional courses In the CARE package 

will be offered. I am Interested In the subject 
matter no matter how It Is presented however, I would 
definitely sign on (pun) again. 

Ridgway Would be more Interested In similar coiir:>e mce 

strongly aimed at the secondary teacher. 
When does CARE 2 begin? 

I got very tired and eyes were very sore. As a 
result I would never register for another course of 
this type. 

Penn State I am Interested In learning more about the field but I 

feel this Is more due to rny Interests in the field. 

Smethport I would like to delve Into each of the topics a bit 

more In detail . 

It has been a very helpful course for me and someday 

I would like to continue. 

Yes, as I teach a slow group. 

A follow up course remedial techniques would be 

Ideal. 
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7. I was more Involved in operating the terminal than in understanding the 
course material . 



Location 






Frequency In Percentage 






Clearfield (N=90) 


4.44 


2.22 


6.67 


2.22 


5.56 14.44 


18.89 


45.56 


Ridgway (N«118) 


0.00 


1.69 


3.39 


6.78 


3.:9 15.25 


22.03 


47.46 


Penn State (N»27) 


0.00 


0.00 


3.70 


0.00 


0.00 7.41 


29.63 


59.26 


Smethport (N'108) 


0.00 
All the 


2.78 


3.70 


3.70 


5.56 9.26 


19.44 


55.56 




1 


2 


3 


4 


5 6 


7 


8 



Clearfield During the first few sessions, the mechanics got in 

the way of the material . However, after that I 
enjoyed the machine. 

Ridgway On several occasions where numbers were used I made 

the nunber 1 with the small letter L. 
It was difficult to concentrate on the course material 
when the machine did not operate properly. 
Once you becora completely familiar with the unit you 
can become totally Involved with the course material. 

Penn State I must admit— the machine was fun. 

The operation of the teminal wax explained well the 
first sessU.i. Working the machine is fairly easy. 

Smethport Terminal is easy to operate. 

Enjoyed using the terminal . It did not bother me at 
all. 

The handicap of not typing bothered me. 
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8. The learning was too mechanical. 



Location 



Frequency in Percentage 



Clearfield (N=90) 
Ridgway (N«118) 
Penn State (N«27) 
Smethport (N*108) 



30.00 16.67 10.00 

43.22 16.95 11.02 

29.63 14.81 3.70 

46.30 17.59 11.11 

Strongly 

Disagree 

8 7 6 



7.78 5.56 7.78 8.89 13.33 



4.24 6.78 
7.41 3.70 
7.41 4.63 



7.63 5.08 5.08 
22.22 18.52 0.00 
8.33 2.78 1.85 

Strongly 

Agree 

3 2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



I prefer the human element. It afforded little chance 
for questioning such as would be available In the 
classroom. 

More quizzes and surprises would have been welcome. 
Individualized Instruction of this nature cannot be 
too mechanical. The content was more Important than 
the type of Instruction. 

I think some type of discussion to supplement the 
course would make It more effective. 
It got monotonous sometimes. 

I enjoyed the opportunity to work at my own speed. 

It fascinated me. 

After all IBM 1510 Is a machine. 
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9. I felt as If I had a private tutor. 



Location Frequency Percentage 



Clearfield (N*90) 


8.89 


6.67 


8.89 


12.22 


5.56 


21.11 


12.22 


24.44 


Ridgwaty (N>118) 


i1 .02 


2.54 


4.24 


8.47 


8.47 


16.95 


15.25 


33.05 


renn State (N«27) 


3.70 


7.41 


3.70 


14.81 


7.41 


14.81 


33.33 


14.81 


Smethport (N-108] 


5.56 


3.70 


3.70 


4.63 


4.63 


12.96 


22.22 


42.59 



Strongly Strongly 

Disagree — Agree 

1 2 3 4 5 6 7 8 



Clearfield 



Rldgway 
Peni! State 



Smethport 



You can't ask questions and need exact answers 
sometimes. 

Sometimes I didn't know what was wrong with the answer 
I had. 



on 



I liked the way mistakes were handled, not going 
until you understood the concept. 

After two years of PSU's mass education It was a Joy 
to get some Individual attention. 
Most of the time this was the feeling I had but at 
times, such as when I had a question concerning the 
material I felt the need of being Instructed by a human. 

I enjoyed the one-to-one basis with the absence of 
extraneous material from either professor or other 
students. 

If I had a tutor I could have asked a question to 

clarify a point. 

The feedback was encouraging. 

I could go as fast as I wanted. 



109 



10. The equipment made It difficult to concentrate on the course material. 



Location 






Frequency In 


Percentage 






Clearfield (N«90) 


7.78 


5.56 


2.22 


3.33 


d.89 


13.33 


18.89 


40.00 


Ridgway (N«118) 


2.54 


6.78 


2.54 


6.78 


8.47 


9.32 


19.49 


44.07 


Penn State (N«27) 


0.00 


0.00 


0.00 


O.CO 


7.41 


11.11 


18.52 


62.96 


Smethport (N«108} 


.93 


.93 


5.56 


10.13 


7.41 


17.59 


20.37 


37.04 




All the 

















Time Never 

1 2 3 4 5 6 7 8 



Clearfield Several sets of earphones could not be adjusted to a 

comfortable position and I had a headache from them. 
Also when the earphones came from the right side I had 
quite a time turning the pages of my notebook. 

Ridgway The equipment, noise and the cold air sometimes caused 

discomfort. 

I felt It difficult to concentrate when some of the 
proctors stood around and would talk. This became 
very difficult to concentrate on your material. 

Penn State The equipment was easy to manage and It only facili- 

tated fify learning. 

Smethport The only difficulty was the air conditioning, but 

understand that was necessary. 
The noise of the air conditioning unit made It hard 
to concentrate. 

Sometimes the machines malfunctioned. 



no 



n. The situation made me quite tense. 



Location 






Frequency In 


Percentage 






Clearfield (N«90) 


48.89 


13.33 


7.78 


5.56 


7.78 


4.44 


3.33 


8.89 


Ridgway (N-118) 


53.39 


16.10 


7.63 


6.78 


5.08 


3.39 


4.24 


3.39 


Penn State (N-27) 


70.37 


14.81 


11.11 


0.00 


3.70 


0.00 


0.00 


0.00 


Smethport (N«108) 


50.26 


!2.96 


6.48 


3.70 


2.78 


6.48 


.93 


7.41 



Strongly 
Disagree— 
8 7 



Strongly 
— Agree 
2 1 



Clearfield 
Ridgway 



Penn State 
Smethport 



For the first few times. 

Only because I felt rushed to finish. 

There was nothing tense about the situation. It was 
the least tense situation I have experienced on the 
college level. 

I felt tense In trying to finish In the six week 
period alloted. 

I felt very relaxed at all times— mostly because I 
could progress at iny own speed. 

When we found out the course would be one week shorter 
than It was Intended It was a chore to finish and as a 
result didn't do the best work. 
I always felt at ease when working. 
I never had time fly by so rapidly. 
I felt very relaxed. 



Ill 



12. Computer-assisted instruction, as used In this course. Is an efficient 
use of the student's time. 



Location 

Clearfield (N«90) 
Ridgway (N=118) 
Penn State (N=27) 
Smethport (N-108) 



Frequency iji Percentage 



57.78 


8.89 


7.78 


3.33 


1.11 


7.78 


7.78 


62.71 


15.25 


3.39 


3.39 


2.54 


2.54 


1 .69 


59.26 


11.11 


7.41 


0.00 


3.70 


3.70 


3.70 


71.30 


9.26 


1.85 


.93 


2.78 


.93 


4.63 



Strongly 
Disagree-— 
8 7 



5.56 
8.47 
11.11 

8.33 

Strongly 
—Agree 
2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



Some method of eliminating materials that one already 
knows might be devised. Also, I felt that more time 
might have been devoted to actual case studies. 
It beats sitting In most classrooms I've been In. 

I feel It does not waste your time with long 
discussions. 

I feel that this course was very efficient. 

The Important thing Is to stay alert whfle using the 
machine and absorb each frame. 
Too much time Is wasted In regular classes when a 
student goes to class even If he won't get anything 
from that particular lecture. This system lets the 
student learn, recite, and get feedback all at the 
same time. 

I feel that this type of Instruction leads to much 

greater retention. 

It was highly efficient. 

It Is terribly efficient ... you work at your own 
pace and don't have to wait until some windbag gets 
finished before you can go on to meaningful material. 
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13. My feeling toward the course material after I had completed the course 
was favorable. 



Location Frequency In Percentage 



Clearfield (N*90) 


5.56 


3.33 


0.00 


1.11 


4.44 


11.11 


17.78 


56.67 


Ridgway (N«118) 


0.85 


4.24 


0.00 


2.54 


2.54 


11.02 


23.73 


55.07 


Penn State (N-27) 


0.00 


0.00 


O.OG 


0.00 


0.00 


18.52 


18.52 


62.96 


Smethport (N>108) 


6.48 


0.00 


.93 


2.78 


2.78 


9.26 


17.59 


60.19 



Strongly Strongly 

Disagree Agree 

1 2 3 4 5 6 7 8 



Clearfield 



Ridgway 



The course content was excellent. 

Everything seemed to be tied together in the end. 

... the first five chapters were a bore. 

The course presented more real examples and applica- 
tions than is usual in a course of this type. 
I enjoyed the course very much 
I would have liked .. . more on the secondary level. 



Penn State I feel that I learned the concepts very well and that 

I can apply them to many other situations in which I 
will be dealing with people (basing assumptions on more 
than 1 or 2 observations, being objective in reporting 
data, etc.). 



Smethport The course made me more aware of problems that occur 

in the school setting. 

I feel it will help me understand many of the problems 
that could be in my classroom that I was not aware of. 
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14. I felt frustrated by the situation. 



Location 

Clearfield (N>90) 
Ridgway (N«118) 
Penn State (N»27) 
Sinethpcrt (N«-''08) 



Frequency iji Percentage 

11.11 4.44 8.89 7.78 5.56 5.56 11.11 45.56 

1.69 1.69 6.78 8.47 8.47 10.17 13.56 49.15 

3.70 0.00 18.52 0.00 3.70 11.11 14.81 48.15 
4.63 1.85 11.11 2.78 6.48 4.63 13.89 54.63 



Strongly 
Disagree— 
8 7 



Strongly 
---Agree 
2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



Yes, some night after your computer broke down about 

two or three times you felt vf»ry frustrated. 

Only the problems In scheduling were a frustration. 

On some occasions I felt I had answered correctly but 
the computer would not accept n\y reasoning. 
Frustrated only when I couldn't go back and review. 
I felt no frustration at any time. 

I felt very good about the situation, as a matter of 
fact, I looked forward to coming to class. 
I felt frustrated a few times when I felt that 
answer was correct but was not received by the com- 
puter as a correct response. 

I felt I had to hurry. 

Only when the machines didn't work. 

If anything this course stimulated me to attend as 

often as time permitted. 



114 



15. I found the computer-assisted instruction approach in this course to be 
inflexible. 



Location 

Clearfield (N=90) 
Ridgway (N^^llS) 
Penn State (N=27) 
Smethport (N=108) 



Frequency iji Percentage 

18.89 14.44 12.22 llJl 10.00 10.00 6.67 16.67 

27.12 12.71 11 .02 10.17 7.C3 11 .86 8.47 11 .02 

33.33 7.41 7.41 7.41 0.00 25.93 7.41 11.11 

36.11 13.89 12.04 8.33 9,26 4,63 9.26 6.48 



Strongly 
Disagree— - 
8 7 



Strongly 
—Agree 
2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



It was inflexible to the extent that any time I 
disagreed or did not understand, there was no real 
opportunity for discussion of the problem. 
The human understanding was not there. 

I wished I could clarify my viewpoint. 
Only with regard to scheduling. 
I would have liked to ask questions and was unable to 
do so. All I was able to do was comment on the ques- 
tions asked. 

It was inflexible in that it often did not respond to 
my weaknesses and review more often. 
Possible such a presentation is somehwat inflexible, 
but the idea hadn't occurred to me until the question 
was asked. Flexibility does not seem particularly 
important in this case. 

Only inflexible in the way that it accepted answers. 
It gave no opportunity for discussion type situations. 
One thing that should be improved is to have a method 
of reviewing certain chapters at all times and not 
whenever you are asked by the computer. 
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16. Material which otherwise Interesting can be boring when presented 
by CAI. 



Location Frequency 1n_ Pe rcentage , 



Clearfield (N=90) 


47.78 


14.44 


11.11 


3 


2. 1 


2.22 


5.56 


13.33 


Ridgway (N«118) 


51.69 


15.25 


8.47 


7.63 


5.93 


2.54 


3.39 


5.08 


Penn State (N-27) 


29.63 


18.52 


14.81 


7.41 


3.70 


22.22 


0.00 


3.70 


Smethport (N=108) 


66.67 


19.44 


4.63 


1.85 


0.93 


2.78 


1 .85 


1.85 



Strongly Strongly 

Disagree Agree 

8 7 6 5 4 3 2 1 



Clearfield More examples should be given to color the course 

material . 

Ridgway It's not boring, however, sitting still for a relative y 

long period of time reduces concentration and lessens 
Interest. 

It was more Interesting because of the novel method of 
presen^'^tlon. 

Penn State I feel discussion would have accented the material 

making It a little more Interesting. 

Smethpcrt This material wai extremely more Interesting than 

regular classrooin activities. I would like very much 

to take many classes by computer. 

I hope we have more opportunity to take more courses. 
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7. I was satisfied with what I learned while taking the course. 



Location 

Clearfield (N«90) 
Ridgway (N'118) 
Penn State (N=27) 
Smethport (N-108) 



Frequency In^ Percentage 



8.89 


2.22 


1.11 


4.44 


2.22 


14.44 


23.33 


5.08 


0.00 


4.24 


.85 


3.39 


8.47 


24.58 


0.00 


3.70 


3.70 


3.70 


0.00 


18.52 


37.04 


2.78 


0.93 


0.93 


4.63 


0.93 


9.26 


21.30 



Strongly 
Disagree— 
1 2 



43.33 
53.39 
33.33 
59.26 

Strongly 
—Agree 
7 8 



Clearfield 
Ridgway 

Penn State 



Smethport 



More time could have been spent on remedies. 
I feel the course was excellent. 

Now If I could put It to use I will be even more 
satisfied. I was hoping there would be more stress on 
secondary (school) problems rather than so much con- 
cern with elementary level. 

For an Introductory course In education of exceptional 
children, I definitely have ended this course with 
satisfaction concerning what I feel I have learned. 
I would have liked to ask some questions and have 
opportunities for discussion. 

As I said before, this has been the best set of 
learning circumstances I have been exposed to thus 
far. 

I was satisfied because I feel it will benefit me In 
n\y work. 
Practical . 
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18. In view of the amount I learned, this method seems superior to classroom 
Instruction for many courses. 



Location Frequency in Percentage 



Clearfield (N=90) 


20.00 


7.78 


1.11 


14.44 


11.11 


12.22 


13.33 


20.00 


Ridgway (N»118) 


11.86 


5.08 


5.93 


6.78 


7.63 


12.71 


18.64 


31.36 


Penn State (N=27) 


14.81 


3.70 


11.11 


0.00 


7.41 


14.81 


18.52 


29.63 


Smethport (N=108) 


3.70 


4.63 


3.70 


7.41 


6.48 


11.11 


16.67 


46.30 



Strongly Strongly 

Disagree - Agree 

1 2 3 4 5 6 7 8 



Clearfield 
Ridgway 



Penn State 



Smethport 



Depending on the course, of course. 

There Is room for both types of instruction. 

Can't take the place of a teacher. 
In the classroom you must go at the teacher's pace of 
Instruction. The computer program lets you go at your 
own pace. 

I feel that the method of presentation must take Into 
account the objectivity or subjectivity of the course 
material . 

This method can be useful especially for survey courses. 
For a few courses maybe, but not all and not neces- 
sarily this one. 

Most classroom Instructors can be more boring and 
biased than any computer. 

I be'ileve In letting someone learn at their own rate 
whenever possible. 

For an Inservlce teacher this has been the best method 
I have found. 

I am a person who likes to ask questions to the profes- 
sor. 
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19. i would prefer computer-assisted Instruction to traditional Instruction. 



Location Frequency In Percentage 



Clearfield (N=90) 


23.33 


10.00 


4.44 


17.78 


10.00 


11.11 


13.33 


10.00 


Ridgway (N>118) 


11.02 


10.17 


5.08 


21.19 


8.47 


12.71 


10.17 


21.19 


Penn State (N»27) 


11.11 


11.11 


11.11 


3.70 


14.81 


25.93 


14.81 


7.41 


Smethport (N=108) 


6.48 


5.56 


8.33 


16.67 


12.04 


12.04 


9.26 


29.63 



Strongly Strongly 

Disagree - - Agree 

1 2 3 4 5 6 7 8 



Clearfield 



Ridgway 



Penn State 



Depends on the subject matter. 

I can go at iny own rate, but lose the Ideas and 

thinking of others. 

Some questions arise that an instructor can often 
times give a better Insight **:zo the answer. 
I would prefer It only In cc.tain classes. 

I enjoyed this course— It was a good change— but I 
don't think I would like to take all of by courses 
by computer. 

For certain courses It Is excellent. 



Smethport 



Depending on the type of course. 

Not In an overall program but In some courses. 

Depends on the Instructor and the class. 
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20. Computer-assisted Instruction is just another step toward de-personalized 
instruction. 



Location 

Clearfield (N»90) 
Ridgway (N=118) 
Penn State (N»27) 
Smethport (N=108) 



33.33 10.00 
47.46 13.46 



25.93 
37.04 



29.63 
18.52 



Strongly 
Disagree-" 
8 7 



Frequency ir^ Percentage 
14.44 7.78 10.00 6.67 



8.47 
11.11 
11.11 



4.24 
7.41 
12.96 



12.71 
0.00 
6.48 



6.78 
18.52 
2.78 



8.89 
2.54 
0.00 
7.41 



8.89 
4.24 
7.41 
3.70 



Strongly 
■--Agree 

2 ■ 1 



Clearfield It's another way of teaching which may be a good 

approach for some learners. 

It's Just as depersonalized in a class with 300 people 
and the prof never sees your face. 

Ridgway CAI definitely has its place in education 

I hope not. I value my job. 

Penn State I felt this was much more personalized than many of 

my classes. 

In many cases depersonalized instruction is not an 
undesirable approach. 



Smethport It will never replace man entirely 

I got d kick out of the machine calling me by my 
first name. 

If something is worth using, use it, even if it is 
somewhat depersonalized. 
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21. I was concerned that I might not be understanding the material 



Location 

Clearfield (N«90) 
Ridgway (N>118) 
Penn State (N-27) 
Smethport (N«108) 



Frequency In^ Percentage 

31.11 17.78 5.56 4.44 6.67 10.00 10.00 14.44 

33.05 20.34 9.32 10.17 5.93 8.47 6.78 5.93 

44.44 7.41 11.11 11.11 0.00 14.81 7.41 3.70 

31.48 16.67 12.04 8.33 3.70 12.04 6.48 9.26 



Strongly 
Disagree— 
8 7 



Strongly 
— Agree 
2 1 



Clearfield 
Ridgway 



Penn State 



Smethport 



Too much vocabulary for the layman. 
Only chapter 14. 

I thought the computer might move too fast but It did 
not. 

Sometimes I was concerned. 

. . .someone cannot help but understand the Informa- 
tion because there was a constant feedback and an 
opportunity to review If felt It was needed. 

With the Immediate and constant feedback there was 
never a question. 

On some Items that I didn't understand, there was no 
way for the computer to explain It any further to me. 

Everything was planned very well. 

This happens at Infrequent Intervals. 

I was quite comfortable In the fact that there would 

be the opportunity for review. 
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22. The responses to my answers seemed appropriate 



Location 



Frequency in Percentage 



Clearfield (N=90) 
Ridgway (N>118) 
Penn State (N=27) 
Smethport (N=108) 



20.00 


17 78 


26.67 


16.67 


8.89 


4.44 


4.44 


1.11 


16.10 


28.21 


24.58 


17.80 


6.78 


4.24 


1.69 


0.00 


14.81 


29.63 


40.74 


11.11 


0.00 


3.70 


0.00 


0.00 


21.30 


25.00 


34.26 


6.48 


7.41 


4.63 


0.93 


0.00 



All the 

Time 

8 7 



Never 

2 . 1 



Clearfield I was most upset when I gave correct responses and was 

told I gave an Incorrect response. 

Ridgway A couple of times I had had the correct answer and It 

was Indicated as wrong, which although understandable 
In a course of this type» still upset me slightly. 
I especially enjoyed seeing my name used. 

Penn State Sometimes I would have liked to argue with the computer 

or felt that the questions were not worded clearly. 
At times I wished I could have had a more detailed 
response. 

Yes they did, however, there Is no provision for 
justifying or qualifying. 



Smethport 



Sometimes I would have liked to give an argument. 
On some occasion n\y answers were adequate and the 
computer refused them. 
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23. I felt uncertain as to iny performance In the programed course relative 
to the performance of others. 



Location 

Clea»-f1eld (N«90) 
Ridgway (N"118) 
Penn State (N=27) 
Smethport (N«108) 



23.33 

6.78 
11.11 

8.33 

All the 

Time 

1 



Frequency in Percentage 

10.00 8.89 14.44 6.67 7.78 

8.47 13.47 12.71 11.86 14.41 

11.11 22.22 0.00 3.70 11.11 

10.19 12.96 12.04 12.96 11.11 



12.22 16.67 

13.56 18.64 

22.22 18.52 

14.81 17.59 



Never 

7 8 



Clearfield 
Ridgway 



Penn State 



Smethport 



No one ever talked about how he was doing. 

I wasn't too concerned with what others were learning. 

I really didn't care how iny performance ranked in 
relation to the performance of others. 
The only indication of your performance in relation 
to others was that they were either completing the 
course at a faster or slower rate than you were. 

I have no idea how the others are doing but I feel as 
though I have done well so the others don't really 
matter. 

Not uncertain, but curious . . . it's a difficult habit 
to break. 

I was not Interested in the performance of others. 
I tried to do the best I could and not worry about the 
others. 

I am a teacher aide and felt very Inadequate most of 
the time. Because of iny situation, though, I feel I 
got more out of the course than most people taking it. 
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24. I was not concerned when I missed a question because nobody was watching 



Location 




Frequency In Percentages 




Clearfield (N-90) 


16.67 8.89 


7.78 


4.44 


2.22 10.00 


15.56 34.44 


Ridgway (N-118) 


11.02 10.17 


9.32 


9.32 


5.93 8.47 


11.86 33.90 


Penn State (N-27) 


14.81 0.00 


14.81 


0.00 


7.41 14.81 


18.52 29.63 


Smethport (N«108) 


16.67 11.11 


10.19 


1.85 


6.48 10.19 


12.04 31.48 




Strongly 








Strongly 



Dlsagree- 
1 2 



-Agree 



8 



Clearfield 



R1dgw«y 



Penn State 



Smethport 



This Is true to some extent, of course no one wants to 
miss the question. 

Superbrain can harass you as much as any person. 

I was concerned with missing an answer because I 
might be misinterpreting the Information. 
I was not concerned when I missed a question because 
I was confident that the designers of the software 
were clever enough to provide prompt remediation. 
I felt It was going against n\y grade. 

I did not like goofing even If no one knew. 
I was disappointed In n\yself when I missed a question. 
I was fairly unconcerned but I did feel someone was 
watching me. 

Yes In a way. I knew the computer would know. It 
seems a natural Instinct to be concerned when I did 
miss a question but then the course was a personal 
learning experience; therefore, the concern left 
shortly. 

I never get too "uptight" about others watching me. 
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25. I found myself trying to get through the material rather than trying to 
learn. 



Location 






Frequency in 


Percentages 




Clearfield (N=90) 


7.78 


3.33 


12.22 


6.67 


11.11 


15.56 


15.56 


Ridgway (N=118) 


4.24 


2.54 


11.86 


8.47 


10.17 


18.64 


23.73 


Penn State (N=27) 


3.70 


11.11 


3.70 


0.00 


7.41 


18.52 


18.52 


Smethport (N«108) 


1.85 


7.41 


9.26 


8.33 


8.33 


23.15 


15.74 




All the 















27.78 
20.34 
37 04 
25.93 



Time — Never 

1 2 3 4 5 6 7 8 



Clearfield 



Ridgway 



Penn State 



Smethport 



Outside pressures . . . time factor. 

I think this ts because I had trouble arranging a 

schedule. 

Bad weather and limited schedule times made me feel 
I might not be able to finish In time. 
I found myself doing this when I learned I did not 
have a great amount of time to finish the course. 

I dwelled upon things I was unsure of because time 
was of no Importance. 

Towards the end of the course I did go a little 
quicker since I saw the end so near, but did not at 
the same time neglect the material. 

Some of the material did not seem to apply or was 

uninteresting. 

I hurried through this. 

The time limit was too short. 

I found I was learning for rnyself. 
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26. I knew whether rf\y answer was right or wrong before I was told. 



Location 






Frequency In 


Percentages 






Clearfield (N»90) 


5.56 


4.44 


10.00 


15.56 


18.89 


25.56 


14.44 


5.56 


Ridgway (N»118) 


5.08 


4.24 


9.32 


9.32 


24.58 


22.88 


18.64 


5.93 


Penn SUte (N=27) 


0.00 


0.00 


3.70 


22.22 


14.81 


25.93 


22.22 


11.11 


Smethport (N-108) 


3.70 


5.56 


12^04 


14.81 


21.30 


20.37 


21.30 


.93 




All the 

















Time Never 

1 2 3 4 5 6 7 8 



Clearfield 
Ridgway 

Penn State 



Smethport 



Usually this could be determined by the way the ques- 
tion was asked. 

Sometimes I was not sure of the question. 
Sometimes I answered without really thinking. 
Sometimes n\y answers would parallel the computer's 
but It wouldn't recognize mine. 

I think that most of rny wrong answers were due to the 
fact that I pushed the keys to enter before checking 
rny answer. 

Found tqyself trying to second guess the computer some- 
times by trying to answer the way I thought It was 
programed rather than the way I thought. 

Most of the time. 
Sometimes. 

Sometimes I got In a hurry. 
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27. In a situation where I am trying to learn something, it is important to 
me to know where I stand relative to others • 



Location 

Clearfield {N=90) 
Ridgway {N=118) 
Penn State (N=27) 
Smethport (N=108) 



Frequency ijn Percentages 

32.22 10,00 llJl 7-78 6,67 10-00 

3K36 12,71 10.17 1K86 3.39 14.41 

33.33 11.11 22.22 3.70 11.11 3.70 

37.04 12.96 7.41 9.26 12.96 12.04 

Strongly 

Disagree 

8 7 6 5 4 3 



11.11 
11 .02 
14.81 
4.63 



11 .11 

5.08 
0.00 
3.70 



Strongly 
•--Agree 
2 1 



Clearfield 
Ridgway 

Penn State 



Smethport 



It gives some incentive to have an idea where you 
stand. 

Since I was taking this course with friends, it seemed 
necessary to keep at least on the same chapter. 
I feel I am learning for myself and myself alone. 

I learn for nyself. 

Unfortunately, in the educational system students 
compete with one another for top grades which contri- 
bute to anxiety. 

The CAI made up for that by showing me where I stood 
relative to myself. 

I think it helps keep me on my toes to know how well 
I am doing In relation to others* 
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28. I guessed at the answers to some questions. 

Location Frequency Iji Percentages 

Clearfield (N»90) 
Ridgway (N-118) 
Penn State (N-27) 
Smethport (N>108) 



1.11 


12.22 


10.00 


12.22 


6.67 


27.78 


26.67 


.85 


5.08 


13.56 


16.95 


12.71 


26.27 


22.88 


7.41 


22.22 


44.44 


7.41 


3.70 


7.41 


7.41 


4.63 


16.67 


25.93 


11.11 


20.37 


12.96 


5.56 


All the 












1 


2 


3 


4 


5 


6 


7 



3.33 
1.69 
0.00 
2.78 



-Never 
8 



Clearfield 



Ridgway 



Penn State 



Smethport 



Sometimes it was necessary as I was stumped on certain 
situation. 

Some of the questions were not clearly stated. 

Sometimes— Occasionally questions offered little hints 
to right answers. 

Sometimes you guessed at the answers especially when 
you were tired and everything was going wrong for you. 

I may have been unsure or misinterpreted the question 
but I feel as though the course gave enough material 
so that I didn't have to guess, (only comment) 

Occasionally. 

Some of the material was not related to my work and 
so I guessed. 
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29. I was aware of efforts to suit the material specifically to me. 



Location 



Freguency Percentages 



Clearfield (N=90) 


13.33 


17.78 


13.33 


10.00 


7.78 


7.78 


13.33 


Ridgway (N=118) 


11.86 


22.88 


16.10 


15.25 


9.32 


15.25 


6.78 


Penn State (N=27) 


11.11 


7.41 


29.63 


11.11 


7.41 


18.52 


3.70 


Smethport (N»108) 


15.74 


25.93 


13.89 


14.81 


12.04 


10.19 


3.70 




All the 














8 


7 


6 


5 


4 


3 


2 



16,67 
2.54 

11.11 
3.70 



-Never 
1 



Clearfield 
Ridgway 

Penn State 

Smethport 



My course looked the same as the people sitting around 
me. 

More at the beginning of the course than at the end« 
especially more reviews. But toward the end I didn't 
need them. After awhile a "good" didn't suffice. 
More "excel lents" are definitely needed. 

I loved when iny name was inserted in a response—That 
motivated me. 

I didn't feel the communication was personal, yet I 
wasn't offended. 

Once in a while. 

The use of names and personal comments helped to 
personalize the course. 

Other than obvious review as shown in the frame 
numbers, I was not aware of individualization. 
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30. 1 was encouraged by the responses given to my answers to questions. 



Location 






Frequency In Percentages 




Clearfield (N=90) 


3.33 


3.33 


4.44 12.22 


7.78 18.89 


18.89 31.11 


Ridgway (N=118) 


3.39 


2.54 


6.78 6.78 


7.63 22.88 


22.88 27.12 


Penn State (N=27) 


3.70 


7.41 


3.70 3.70 


3.70 37.04 


25.93 14.81 


Smethport (N=108) 


4.63 


1.85 


1.85 3.70 


8.33 21.30 


23.15 35.19 




Strongly 






Stf*ongly 



Disagree— 
1 2 



—Agree 
7 8 



Clearfield 



Ridgway 



Penn State 



They in some way substituted for the human teacher. 
The computer has a real sense of humor at the 
strangest times. 

I wish it would have responced with roy name more 
often. This made It have a very personal teacher to 
student effect. 

Answers to my responses enabled me to understand a 
concept a little more fully. 

At first I thought it was really neat, but after 
a while the responses became a little monotonous. 
At times the comments did not seem to help but rather 
just confused me more. 



Smethport 



Everyone likes praise, I agree with the question. 
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31. In view of the time allowed for learning, I felt too much material was 
presented. 



Location Frequency in Percentages 



Clearfield (N=90) 


28.89 


17.78 


7.78 


7.78 


7.78 


12.22 


3.33 


14.44 


Ridgway (N=118) 


42.37 


19.49 


12.71 


7.63 


5.08 


6.78 


.85 


5.08 


Penn State (N=27) 


59.26 


22.22 


11.11 


0.00 


3.70 


0.00 


3.70 


0.00 


Smethport (N»108) 


47.22 


11.11 


5.56 


6.38 


3.70 


13.89 


4.63 


7.41 



Strongly Strongly 

Disagree - —Agree 

8 7 6 5 4 3 2 1 



Clearfield 



Ridgway 



Penn State 



Smethport 



A great deal of information was presented in the 
course of CAI. The major problem seemed to be in the 
scheduling of time. 

Not if the time had been more evenly distributed. 

The material was not too heavy or difficult for the 
time. 

I felt that the course was overscheduled as to students < 
A better scheduling program should be devised. 

I am amazed that so much material could be presented 
effectively In a short time, but I do feel that the 
presentation was effective. 
I do not feel toe much material was presented. 

I felt our time was cut short; therefore, we were 
cramming. 

The short period of time the van was going to be here 
made me buckle down and study more than I would have 
In a traditional situation. 



32. I entered wrong answers in order to get more information from the 
machine. 
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Location 






Frequency in Percentages 




Clearfield (ri=90) 


0.00 


1.11 


4.44 


12.22 


8.P.9 13.33 


21.11 


Ridgway (fl=118) 


0.00 


3.39 


4.24 


5.93 


8.47 16.95 


22.03 


Penn State (N=27) 


7.41 


0.00 


3.70 


0.00 


0.00 22.22 


41.81 


Smethport (N=108) 


0.00 
All the 


3.70 


6.48 


8.33 


8.33 12.96 


19. A4 




1 


2 


3 


4 


5 6 


7 



38.89 

51.85 
40. 7A 



-f lever 
8 



Clearfield 



Ridgway 



Sometimes I entered wrong answers just to see what 
would happen. 

Please tell us at the beginning of the course how we 
are graded. I wanted to enter wrong answers sometimes 
but wasn't sure if we should or not. 

I didn't think that this could be done. I sometimes 
actually guessed and guessed correctly just to finish 
and move on. 



Penn State 
Smethport 



No con^r^ents. 

I did sometir OS if I wasn't positively sure of an 
answer. Sometimes I felt the explanation following 
the wrong answers were very helpful, so I would try 
soiTie of then. 



r 
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33. I felt I could work at iqy own pace 



Location 



Frequency ji Percentages 



Clearfield (N=90) 


8.89 


2.22 


5 


.56 


5 


56 


6 


,67 


10.00 


15,56 


Ridgway (N=118) 


5.93 


0o85 


1 


.69 


1 


69 


3 


.39 


7.63 


13.56 


Penn State (N=27) 


3„70 


0.00 


0 


00 


0 


.00 


0 


00 


0„00 


29.63 


Smethport (N=108) 


6.48 


0.93 


4 


.63 


3 


,70 


2 


.78 


6.48 


12.96 



45.56 



66.67 



Strongly 
Disagree— 
1 2 



Strongly 
---Agree 
7 8 



Clearfield 



Ridgway 



Penn State 



Smethport 



There were plenty of times I felt I could have covered 
certain sections more rapidly <. 
I would have strongly agreed ^f the scheduling had 
been easier^ 

I was not begged down by slower students « 

The only thing that hindered this was the tight 

scheduling. 

Many times I wished I could push the information 
appearing on the CRT a bit faster. 

I started out coming to the lab very often at first 
during the beginning of the term with the Idea that If 
I'd come often when the work load in n\y other courses 
was light I would be able to slacken off my pace at 
other times c I Hked this aspect very mucho 

I could work at my own speed even though I rushed at 
times personally o 

This is a big selling factor to people who teach an J 
therefore have limited time. 
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34. Questions were asked which I felt were not related to the material 
presented. 



Location 

Clearfield (N-90) 
Ridgway (N-118) 
Penn State (N»27) 
Smethport (N-108) 



Frequency In Percentages 

44.44 25.56 15.56 5.56 4.44 2.22 2.22 0.00 

38.14 31.35 17.80 5.93 5.08 0.85 0.00 0.85 

62.96 22.22 7.41 0.00 0.00 7.41 0.00 0.00 

54.63 23.15 12.96 4.63 2.78 0.93 0.00 0.93 



All the 

time 

1 2 



Never 

7 8 



Clearfield 
Ridgway 

Penn State 
Smethport 



On some chapters, (only conment} 

I felt the test contained questions which might of 
had several good answers and the material had not been 
covered well enough during the course. 

The questions were always related to the material, 
(only comment) 

No connents. 
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35. I was aware of the flickering screen while I was taking the course. 

Frequency in Percentages 



Location 



Clearfield (N=90) 


8.89 


3.33 


5.56 


8.89 


8.89 


11 .11 


21.11 


Ridgway (N=118) 


7.63 


5.08 


7.63 


9.32 


6.78 


19.49 


19.49 


Penn State (N=27) 


3.70 


7.41 


11.11 


7.41 


11.11 


11 .11 


29.63 


Smethport (N=108) 


4.63 
All the 


3.70 


6.48 


9.26 


10.19 


16.67 


26.85 




1 


2 


3 


4 


5 


6 


7 



32.22 
24.58 
18.52 
22.22 



Clearfield 
Ridgway 

Penn State 
Smethport 



-Never 
8 



Just like watching TV. 

Could not use eye glasses to advantage. 

What flickering screen? 

Many times I found this quite distracting. 

I didn't find it a problem* but yes I was aware of the 

flickering screen. 

Only when I stayed too long and iny eyes began to hurt. 
At first I was aware of this but after the first day 
this never caught my attention. 

Did not bother meo 

I became used to the flickering. 

Sometimes were worse than others. 
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36. Material which Is otherwise boring can be Interesting when presented 
by CAI. 



Location 

Clearfield (N=90) 
Ridgway (N»118) 
Penn State (N»27) 
Smethport (N»108) 



14.44 3.33 

5.08 2.54 

7.41 0.00 

3.70 0.00 



Frequency iji Percentages 

4.44 15.56 13.33 11.11 

1.69 14.41 5.93 20.34 
11 .11 0.00 11.11 33.33 

3.70 9.26 7.41 20.37 



13.33 24.44 

20.34 29,66 
33.33 3.70 
17.59 37.96 



Strongly 
Disagree— 
1 2 



Strongly 
—Agree 
7 8 



Clearfield 

Ridgway 

Penn State 
Smethport 



The fascination of the method helps. 

If material Is not Interesting I don't think even CAI 

can make It so. 

I would not want to generalize that far. 

I felt very Involved with the course. Sometimes In a 

classroom your mind wanders, here It couldn't. 

Due to the varied ways of presentation and the 
challenge It confronted me with. 

I really enjoyed the course because of the way It was 
presented . 

Only because you work at your own rate. 
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37. I could have learned more If I hadn't felt pushed. 



Location 



Frequency l£ Percentages 



Clearfield (N=90) 


32.22 


12.22 


4.44 


6.67 


8.89 


11 .11 


10.00 


Ridgway (N=118) 


46.61 


13.56 


4.24 


5.93 


4.24 


10.17 


7.63 


Penn State (N=27) 


51.85 


22.22 


11.11 


7.41 


3.70 


0.00 


0.00 


Smethport (N=108} 


32.41 


18.52 


7.41 


5.56 


5.56 


9.26 


7.41 



Strongly 
Disagree— 
8 7 



14.44 
7.63 
3.70 

13.89 



Strongly 
—Agree 
2 1 



Clearfield 

Ridgway 

Penn State 
Smethport 



Again poor scheduling. 

I did not have time to read the complete reading 
assignments In the text by Smith because I am a full 
time teacher. 

I never felt as If I was pushed. I worked at my own 
pace. 

I did not feel pushed until the question of being able 
to finish In the time limit arose. 

I never felt pushed. 

I created t^y own pressures. 

Who felt pushed? 

It was tny own fault for not scheduling more time at 

the beginning of the course. 

I pushed thyself because I was learning. 
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38. I was given answers but still did not understand the questions. 



Location Frequency vn Percentages 



Clearfield (N«90) 


4.44 5.56 


4.44 


7.78 


10.00 


24.44 


23.33 


20.00 


Ridgway (N=118) 


0.00 5.08 


5.93 


8.47 


7.63 


20.34 


32.20 


20.34 


Penn State (N«27) 


3.70 11.11 


18.52 


7.41 


3.70 


7.41 


25.93 


22.22 


Smethport (N=108) 


0.93 2.78 
All the 


6.48 


5.56 


8.33 


24.07 


27.78 


24.07 




1 2 


3 


4 


5 


6 


7 


8 



Clearfield 
Ridgway 

Penn State 



Again certainly on some chapters. Other chapters 
seemed to go overboard to explain things. 

I didn't understand a few things and would feel better 
If I could take more time and ask someone a question 
but none was around to ask. 
Some questions were poorly phrased. 

Very rarely~I can't remember a specific example. 
Sometimes this was true. 



Smethport 



Some of the things I did not know enough about did 
not have enough of a preliminary explanation. 
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39. The course material was presentea too slowly. 



Location Frequency In Percentages 



Clearfield (N=90) 


3.33 


7.78 


8.89 


10.00 


10.00 


18.89 


15.56 


25.56 


Ridgway (N=118) 


4.24 


3.39 


8.47 


12.71 


9.32 


23.73 


12.71 


25.42 


Penn State (N=27) 


0.00 


14.81 


IMl 


7.41 


3.70 


29.63 


14.81 


18.52 


Smethport (N=108) 


0.93 


3.70 


4.63 


12.04 


9.26 


19.44 


20.37 


29.63 



All the 

Time Never 

1 2 3 4 5 6 7 8 



Clearfield 
Ridgway 



Penn State 



Smethport 



Occasionally a point was drilled too long. 
Quite a few of the earlier chapters were. 

The audio seems slow at times. 

Not necessarily too slowly but in some areas that were 
particularly familiar to me I felt that too much of the 
same content was repeated. Perhaps others did not feel 
this way. 

The rate of presentation of material can be controlled 
by each student. 

Sometimes. 

Sometimes It seemed the machine was really laboring 
a concept that was very simple and It would get very 
boring. 

Only when the machine was working too slowly. 
Sometimes I felt the computer was giving me too much 
background material . 



139 



40. The responses to niy answers seemed to take Into account the difficulty 
of the question. 



Location 






Frequency In Percentages 




Clearfield (N»90) 


5.56 


5.56 


8.89 15.56 10.00 15.56 


24.44 14.44 


Ridgway (N-118) 


1.69 


1.69 


4.24 14.41 11.02 20.34 


22.03 24.58 


Penn State (N«27) 


0.00 


0.00 


14.81 0.00 18.52 18.52 


40.74 7.41 


Smethport (N>108) 


2.78 


1.85 


3.70 11.11 7.41 20.37 


27.78 25.00 




Strongly 




Strongly 



8 



Clearfield 



Ridgway 



Penn State 



Smethport 



Sometimes It was not clearly explained why some 
answers were right and others were wrong. 
Chapter 14 was very bad for me. 

But I sure wish the course would take Into account n^y 
poor spelling. 

To me one of the advantages of CAI seemed more notice- 
able on the case studies and the math parts. 

If I made an Incorrect response, I was given more 
Information with which to work and another opportunity 
to respond. 

Sometimes I did not read a question fully. 
Just the audio messages did at times. 
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41. While on computer-assisted instruction, I encountered mechanical 
malfunctions. 



Location 

Clearfield (N=90) 
Ridgway (N=118) 
Penn State (N=27) 
Smethport (N=108) 



8.89 
4.24 
0.00 
4.63 



14.44 
11.02 
14.81 
9.26 



Frequency vn Percentages 
20.00 15.56 15.56 16.67 



14.41 
14.81 
20.37 



17.80 
7.41 
22.22 



16.95 
11.11 
12.96 



17.80 
37.04 
17.59 



7.78 1.11 

11.86 5.93 

14.81 0.00 

10.19 2.78 



All the 

Time Never 

1 2 3 4 5 6 7 8 



Clearfield 



Ridgway 



Penn State 



Smethport 



Yes as a matter of fact yesterday I came for the last 
time and sat down at three machines before one of them 
worked. 

Far too often. 

I very seldom encountered malfunctions but there were 
occasions when material was not available for me to 
continue ii\y work. 

Yes, sometlmei . These malfunctions were always cleared 
and handled by the proctors. 

There are a few bugs to iron out although the machines 
were pretty efficient. 

There were a few malfunctions; however, I did not feel 

they were objectionable. 

Very rarely that couldn't be fixed right away. 

On a few occasions and so I would hesitate to say 
always. 

Mechanical malfunctions came about much less often 
than I had aniticpated. 
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42. Computer-assisted Instruction did not make It possible for me to learn 
quickly. 



Location Frequency In^ Percentages 



Clearfield (N-90) 


41.11 


17.78 


15.56 


8.89 


7.78 


3.33 


0.00 


5.56 


Ridgway (N'118) 


49.15 


18.64 


;2.71 


5.08 


4.24 


1.69 


4.24 


4.24 


Penn State (N«27) 


37.04 


18.52 


22.22 


3.70 


3.70 


7.41 


0.00 


7.41 


Smethport (N-108) 


55.56 


23.15 


8.33 


5.56 


1.85 


0.00 


3.70 


1.85 



Strongly Strongly 

Disagree — Agree 

8 7 6 5 4 3 2 1 



Clearfield 
Ridgway 



Penn State 



I learned much more In a shorter amount of time than 
I have experienced In very many other courses. 

I think I was able to think a lot faster In many situa- 
tions where otherwise I would have been unable to do so. 
I learned much but I feel that I have learned the major 
concept of being aware of the possible reasons for 
there being differences In niy classroom and to try to 
help these students. 

There were many different means of learning this course. 
I think It made learning quickly more possible. 



Smethport 



Some of the math was difficult to learn from the machine. 
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Summary of SOS Scores at Three Locations 

There was reason to believe that the attitude of the su dents taking the 
CARE 1 course (as reflected by their SOS scores) would impro/e at each succes- 
sive site because of the formative evaluation which generated changes In the 
course and In operating procedures. 

A grouped frequency distribution of student's SOS scores from Clearfield, 
Ridgway, and Smethport, Pennsylvania appears In Table 4. A total of 21 stu- 
dents scored less than 189 (a neutral score) on SOS. A smaller percentage of 
students received low SOS scores at each successive location. The mean SOS 
score was also found to Increase at successive locations. 

In order to test the significance of this improvement trend, a 1 x 3 
analysis of variance was performed on the SOS scores from the three locations. 
Results of the analysis of variance appear In Table 5. A highly significant 
F of 9.88 was obtained, and the null hypothesis was rejected. In light of the 
fact that the homogeneity of variance assumption had been violated, the Behrens- 
Fisher t' statistic was computed on pairs of SOS scores to determine which 
pairs of SOS scores accounted for the difference. Results of the Behrens- 
Fisher t' test are reported in Tables 6, 7, and 8. 

The Clearfield-Ridgway comparison and the Clearfield-Smethport comparison 
were both significant beyond the .01 level of confidence. The Ridgway-Smeth- 
port comparison was not significant. There was, however, a trend to indicate 
Improvement at the Smethport location. 

It can probably be concluded then that the formative evaluation of CARE 1 
was successful in bringing about Improvements in the course as indicated by 
the Increase in mean SOS scores, lower variability between scores at each loca- 
t1on> and a smaller percentage of scores lower than 189 at each successive 
location. 

It may further be concluded that the decrease in variability of SOS scores 
and the lower percentage of scores below 189 at each successive location may 
indicate that the changes made took into consideration the dislikes of indivi- 
duals at the lower end of the SOS scale and made the course and CAI much irore 
acceptable even to individuals who were extremely critical. 



Table 4 



Grouped Distribution of the Student Opinion Survey 

Scores fo<^ Students who took CARE 1 at 
Clearfield, R1* jway, and Smethport, Pennsylvania 



Score 


Frequency 


300 + 


3 


286 - 299 


33 


272 - 285 


41 


285 - 271 


55 


244 - 257 


49 


230 - 243 


45 


216 - 229 


36 


202 - 215 


23 


188 - 201 


11 


174 - 187 


10 


160 - 173 


2 


146 - 159 


1 


132 - 145 


6 


118 - 131 


0 


104 - 117 


1 


90 - 103 


1 




N = 317 



Table 5 

Analysis of Variance of Total SOS Scores 
from Clearfield, Ridgway, and Smethport 





Source 


df 


ms 


f 


Between 
Within 


2 

314 


11791 
1193 


9.882* 



*p < .01 



Table 6 

Means, Standard Deviations, and Behrens-Flsher t' 
Statistic for SOS Scores for Ridgway and Smethport 





Location 


n 


mean 


s.d. 


t' 


Ridgway 
Smethport 


125 
115 


247.38 
254.07 


33.76 
28.77 


1.656 
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Table 7 

Means, Standard Deviations, and Behrens-Fisher t' 
Statistic for SOS Scores from Clearfield and Ridgway 





Location 


n 


mean 


s.d. 


f 


Clearfield 
Ridgway 


77 

125 


231 .65 
247.38 


42.76 
33.76 


2.75* 



*p < .01 



Table 8 

Means, Standard Deviations, and Behrens-Fisher t' 
Statistic for SOS Scores for Clearfield and Smethport 



Location 


n 


mean 


s.d. 


f 


Clearfield 


77 


231 .65 


42.76 


4.03* 


Smethport 


115 


254 97 


28.77 





*p < .01 
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Clearfield 

The coefficient alpha reliability of the SOS administered at this location 
was .90. The means and standard deviations are reported in Table 7. Eleven 
students had SOS scores of less than 189, which is the theoretical neutral 
score. 

An examination of the comments of these 11 individuals and their ratings 
for each statement in SOS reveals that primarily their expressed low opinions 
related to mechanical problems as opposed to course oriented problems. 

The Clearfield operation was plagued at the beginning by power connected 
machine failures which in turn produced scheduling problems and cancelled "on- 
line" appointments. 

Originally the CAI system was to be installed in a mobile van for the 

Clearfield location. However, due to production difficulties, the van was not 

ready, and so the system was Installed in a room at the Clearfield High School. 

The former vocational shop was not designed for classroom use. Poor acoustics 

also contributed to the Instruction problems. The negative comments below 

reflect both the mechanical problems and the distracting physical surroundings. 

I was signed off more than I was signed on. 

I dislike CAI most because of the malfunctioning of the 
equipment which made it rather difficult to concentrate 
on the content of the material attentively. 

The mechanical failures were very frustrating. 

Lighting was quite bothersome. 

More quiet will be necessary to concentrate and not so 
much pressure to get done with the course. 

Scheduling time was a problem and mechanical failure 
frustrating, but the course was wonderful. 

The system has to be made more stable ... I could have 
proceeded faster if there were less interruptions. 

In spite of these problems, the overall attitude appeared to be favorable 

as exemplified by the mean SOS scores (Table 7) and the students' comments. 

The following comments, taken from SOS indicate those things they liked best 

about the CARE 1 course. 
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I liked CAI because, 

1. CAI was located where I work, 

2. I could choose working time on the CAI at my 
convenience, 

3. Many fellow teachers were Involved and much 
Interest In the course resulted. 

I really enjoyed CAI very much. The material Is presented 
In a fresh and Interesting way. I feel as though I have 
had a private tutor. I am amazed at the complexity of 
problems facing our children and feel as though I have 
gained a better understanding of how to help them. 

I like the flexible scheduling time. 

I like CAI Instruction because I learned more than I 
probably would have using traditional teaching methods. 
You have to learn the course material presented. The 
station would not proceed until It was sure that you 
had adequately learned the material presented. Unlike 
In a classroom situation where you can tune out your 
teacher or professor, you could not tune out or shut 
out your station* you just had to learn. 

The equipment was extremely patient when I had trouble 
with the material . 

I did enjoy the material of the CAI course of EEC 400. 
In most cases I really did get some new Insights Into 
the problems of educating students with deviations. 
I believe the course was beneficial to me and It Is 
already a factor In Improving some of the methods of 
teaching and also testing procedures that I am using 
In the classroom situation. I am considering the 
differences that need to be noted to help the student 
Improve In the school learning situation. 



Ridgway 

The coefficient alpha reliability of the SOS administered at Ridgway was 
.86. The mean and standard deviation are reported In Table 7. A comparison 
of the mean score at Ridgway with the mean score obtained at the previous 
location (Clearfield) revealed a 15 point mean Increase. There also were 
fewer people (only 7) whose expressed SOS score was less than 189 as compared 
to the students who took the course In Clearfield. 

The modifications made In the course, fewer mechanical problems, and 
changes In operating procedures generated by the formative evaluation appear 
to have contributed to the higher mean SOS score at Ridgway. 
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While many Improvements were made in the course between the time the 
course was offered at Clearfield and Ridgway, students still commented on 
specific problems. Primarily these dealt with scheduling and the low tempera- 
ture of the van. There were also some comments dealing with the computer not 
accepting the student's response and about distracting noises from the proctors 
and Other students. 

The comments below reflect the opinions of the students who took the 
course In Ridgway. 

I did not feel pushed In the course. 

At times I became discouraged because the computer Insisted 
that my answer was wrong because I had used slightly differ- 
ent terminology. 

Some consideration should be given to a new cooling system 
so that one Is not distracted by the cold air. 

I felt the course was good except for scheduling. 

I liked the course. Although we sometimes encountered 
mechanical problems, and although the room was sometimes 
freezing, the advantages far outweighed this. 

I liked the availability a^d the ability to work at your 
own pace best. I feel It covered the course as well as 
possible, perhaps a little more testing per each chapter 
would help. 

The time for the course could be more organized and the 
temperature of the room more constant. 

I enjoyed the course very much. At first It scared me but 
as time went on I found It exciting and Intend to use It 
In my classroom. 

I liked It because I was given much learning In a short 
time without having to travel a long distance. 

The most frustrating part of the course was the difficulty 
scheduling. This was no doubt due to the number of students 
enrolled and could certainly be more efficiently planned. 
Course content was not only Interesting but well presented. 

I enjoyed this course very much. I liked working at iny own 
pace and also I liked not having the pressure of a classroom 
situation. I would very much like to take other courses 
such as this. At times I would have liked It to be a little 
more flexible, but I feel this Is a good way to learn mate- 
rial. I know for rr\yself that I am more likely to retain mate- 
rial that I have read and then been reinforced with material 
by short quizzes and review. 
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I like computer instruction for the following reasons: 
No personality conflicts, positive reinforcement, 
organized planning, elimination of stressful situations. 
I did not like it because of tediousness ... The small L 
could not be used as a 1 . 



The Pennsylvania State University 

The 27 students who took the CARE 1 course at Penn State during the winter 
term, 1971, were randomly selected from a group that had registered for 
EEC 400, an Introduction to exceptional children course taught at Penn State. 
During the winter term the EEC 400 course covered the same material and con- 
cepts as the CARE 1 course offered by CAI. A study was to be conducted com- 
paring the CAI group with the conventionally Instructed groups on the effec- 
tiveness of CAI as teacher.*' When registering for the EEC 400 course none of 
the students realized that some of them would be selected to take the course 
by CAI. 

The students' comments below reflect their attitude toward taking the 

EEC 400 course by CAI. 

I enjoyed being called by iny first name. 

I feel as though I finished the course In about as much 
time with the computer as I would spend In class (possibly 
a little more) but I took as much time on the material as 
I felt was necessary to develop an understanding. 

Sometimes I would have liked to argue with the computer 
or felt that the question was not worded clearly. 

How do you argue with a computer? 

After two years of PSU's mass education It was a joy to 
get some Individual attention. 

I found the situation I was forced Into very frightening. 
As far as I'm concerned the way I was dragged into this 
method of instruction was not good. I started this instruc- 
tion with a negative attitude because I was forced Into the 
situation unwillingly. This method of instruction had to 
be doubly Interesting for me to compensate for the start 
with a negatively biased opinion. 

I liked coming here on n\y own time and not having to go to 
class. I also think I learned a lot and covered a lot of 
material In a short amount of time. I did not like the 
audio messages. 
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I liked the course because It was so different and 
because I wasn't competing but I feel as though I 
missed something by not being able to take part In 
classroom discussions and by not receiving any Informa- 
tion that a professor can give from his own experiences. 

I enjoyed working with a computer for the simple fact 
that I could work at my own speed. However, at times 
I could not get the computer to understand the fact 
that I simply could not answer some of Its questions. 

Overall, It was a fascinating experience, however, at 
times the computer went too slowly, and there was no 
way to speed It up If you already understood the con* 
cept that It was trying to drum Into your head. 

A comparison of the Penn State students and the students from Clearfield 
or Ridgway could not be validly made because the Penn State students repre- 
sented an entirely different population than those In the other two locations. 
For this reason only a summary of the Penn State students' SOS scores were 
made. 

The coefficient alpha reliability of the SOS administered at Penn State 
was .86. The mean total score was 245.7 with a standard deviation of 40.47. 
The grouped frequency distribution In Table 9 Indicates that only two students 
had SOS scores of less than the theoretically neutral score of 189. 

The comments recorded by the entire group were for the most part quite 
favorable. Some students Indicated that they would have preferred to take 
the course with an Instructor as opposed to a computer but the vast majority 
felt the CAI was more efficient and enjoyable. They especially liked the 
flexibility of scheduling and working at their own speed. 

A comparison of the results of the CAI group and the conventional 
instruction group on performance are reported elsewhere In the report. 

Smethport 

The coefficient alpha reliability of the SOS administered at Smethport was 
.82. The mean score and standard deviation are reported In Table 8. Only 3 
persons rated SOS scores lower than the theoretical neutral score of 189 at 
this location. 
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Table 9 

Group Distributions of Student Opinion 
Survey Scores for Students who took CARE 1 at 
The Pennsylvania State University 



Score Frequency 
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n » 27 



The formative evaluation of CARE 1 was still being conducted at the 
Smethport location. Student opinions of the course continued to Improve. 
This may be Inferred, In contrast to previous locations, from the higher mean 
SOS scores, smaller standard deviation of SOS scores, and the smaller per- 
centage of persons with SOS ratings less than 189. 

Fewer negative comments on specific problems were also noted. Those that 
were received at the present location covered a number of topics and may be 
accounted for by individual tastes. A number of students commented on the cold 
air conditioning system, and a few students commented on answers that the com- 
puter would not accept. Scheduling was much less a problem at this location 
than In preceding ones. On the whole, reception of the course at Smethport was 
the most favorable of any of the locations. An overwhelming majority of the 
comments were positive. Listed on the following page are some of those comments. 



I liked the presentation, the convenience of scheduling 
my own time, the supplementary materials. My only real 
complaint Is the weather Inside the van. Perhaps this 
Is unavoidable. Good job, Penn State. 

I liked the freedom of scheduling my own time and not 
having a strict schedule. 

It was real Interesting and I liked the pace. 

The course was Informative and saved time. 

The only complaint I have Is that the computer van Is 
just too darn cold. 

The course seems relevant to the teachers who will use 

the material presented every day . . . Can't wait for a 

follow-up course In remedial techniques. 

I liked It because It enabled me to take an active part. 
I find regular classroom Instruction very boring. 

I thought It was great I wish I could get courses In the 
math field. 

The only problem I encountered was that of extra-curricular 
noise. I.e., from the air conditioner and especially from 
the proctors and other students. Every other aspect was 
really above my expectations for a course of this nature. 

In general It Is a practical method of Instruction— sched- 
uling of course time. In regard to personal likings, 
seemed good to me. 

The availability of audio, visual, and typing equipment 
makes the course more Interesting. 

I think at times the material was presented too slowly— 
however, for the most part I enjoyed the course very much 
and would like to take another of Its type at a future date. 

I enjoyed the course and found In a few Instances that 
answers turned out right and were marked wrong. This Is n\y 
only complaint. 

The total SOS score and the small percentage of persons with SOS scores of 
less than 189 are an Indication that the formative evaluation being conducted 
Is helping to bring about constructive changes In the course and In the 
operating procedures. 



